-- Logs begin at Tue 2022-05-10 20:04:28 UTC, end at Tue 2022-05-10 21:54:42 UTC. -- May 10 20:49:06.957265 dv-cinder-828807-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 10 20:49:06.966101 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 20:49:06 2022] *** May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: nodename: dv-cinder-828807-2-iscsi May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: machine: x86_64 May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: clock source: unix May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: pcre jit disabled May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: detected number of CPU cores: 4 May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: current working directory: / May 10 20:49:06.968238 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: detected binary path: /usr/bin/uwsgi-core May 10 20:49:06.968920 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: your processes number limit is 47680 May 10 20:49:06.968920 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: your memory page size is 4096 bytes May 10 20:49:06.968920 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: detected max file descriptor number: 2048 May 10 20:49:06.968920 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: lock engine: pthread robust mutexes May 10 20:49:06.968920 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: thunder lock: enabled May 10 20:49:06.968920 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 10 20:49:06.968920 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 20:49:07.014808 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: Python main interpreter initialized at 0x55fd7b0899c0 May 10 20:49:07.014808 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: python threads support enabled May 10 20:49:07.014808 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: your server socket listen backlog is limited to 100 connections May 10 20:49:07.014808 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: your mercy for graceful operations on workers is 90 seconds May 10 20:49:07.015158 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: mapped 403077 bytes (393 KB) for 2 cores May 10 20:49:07.015261 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: *** Operational MODE: preforking *** May 10 20:49:07.015543 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: *** uWSGI is running in multiple interpreter mode *** May 10 20:49:07.015543 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: spawned uWSGI master process (pid: 80279) May 10 20:49:07.015745 dv-cinder-828807-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 10 20:49:07.016709 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: spawned uWSGI worker 1 (pid: 80290, cores: 1) May 10 20:49:07.016709 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: spawned uWSGI worker 2 (pid: 80291, cores: 1) May 10 20:49:07.016856 dv-cinder-828807-2-iscsi devstack@keystone.service[80279]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 20:49:12.828086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:49:12.828086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: from cryptography.utils import int_from_bytes May 10 20:49:12.829534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:49:12.829534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes May 10 20:49:12.830093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:49:12.830093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: from cryptography.utils import int_from_bytes May 10 20:49:12.830211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 20:49:12.830211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: from cryptography.utils import int_from_bytes May 10 20:49:12.878947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:49:12.879102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:49:12.879284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] command line args: [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:49:12.879555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:49:12.879734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ================================================================================ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:49:12.879988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] admin_token = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.880096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 20:49:12.880234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] config_dir = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.880322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 20:49:12.880402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.880481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] command line args: [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 20:49:12.880613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] config_source = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.880734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 20:49:12.880822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] debug = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.880901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ================================================================================ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 20:49:12.880975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.881267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.881381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.881482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config_dir = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.881584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.881694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.881805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] config_source = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.881901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] debug = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882552 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] log_config_append = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] log_dir = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.882949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] log_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_config_append = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_dir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.883993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.884979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.885946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] publish_errors = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.886955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.887108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.887239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.887363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.887543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.887744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.887823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.887933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] publish_errors = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] standard_threads = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.888988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] use_journal = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] use_json = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] standard_threads = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] use_stderr = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] use_syslog = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.889926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.890004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.890088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_journal = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.890217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.890297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_json = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.890431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_stderr = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.890516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.890610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] use_syslog = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.890695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.890843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 20:49:12.890924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.891101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.891201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.892893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.893850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.894963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.895966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.896995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.897951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.898874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.899963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900295 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.900923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.901868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.902933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.903966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.904899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.905989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.906077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.906225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.906304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.906454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.906529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.906706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.906793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.907586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.907691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.907843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.907925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.908871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.909863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.910991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.911072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.911278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.911362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.911522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.911610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.911765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.911852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.912953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.913956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914189 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.914891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.915878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.external = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.916995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.password = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] auth.token = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.external = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.917931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.918012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.918159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.918249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.password = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.918403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.918484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] auth.token = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.918647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.918989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.919967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.920902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921552 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.921875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922032 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922121 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.922954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.923173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.923276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.923392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.923520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.923627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.923771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.923873 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.924886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.925968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.926999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.927976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.928918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.929886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.930983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931236 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.931942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.932976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.933911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.934846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.935967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.936970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.937917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.938103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.938249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.938416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.938498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.938656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.938889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.938970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939883 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.939963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940118 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.940907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941050 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941766 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.941848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.942946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.943994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.944944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.945887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.946974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.947943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948032 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.948898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.949968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] role.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] role.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.950942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.951908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.952878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.953042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.953131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.953287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.953369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.953532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.953613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.954299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.954515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.954666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.954748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.954920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.955945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.956106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.956190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.956355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.956492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.956624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.956764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.956894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.957938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.958078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.958259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.958394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.958526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.958656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.958785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.958914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959203 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.959965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.960998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.961235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.961362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.961495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.961637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.961768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.961899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.962916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.963049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.963231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.963358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.963499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.963628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.963628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.963914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.964985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.965113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.965241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.965384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.965513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.965513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.965765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.965893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.966951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.967079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.967231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.967364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.967532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.967658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.967786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.967912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.968966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80291) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 20:49:12.969233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 20:49:12.998671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:12.999102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:12.999271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:12.999420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:12.999557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:12.999694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.008809 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.009303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.037070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.037294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.037672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.037910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.090695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.091283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.142760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.142982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.143603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.143842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.209507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.209719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.209858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.209993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.210125 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.210316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.210455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.210587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.210718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.210847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.210984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.211115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.234890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.235183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.235339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.235519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.235677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.235810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.235940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.236069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.236198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.236335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.236464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.236593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.236722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.236851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.247760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.247926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.263457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.263692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.263924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.264149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.264357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.264447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.264572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.264754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.264840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80290) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.265104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.265390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.265672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.265950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.266229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80291) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 10 20:49:13.282684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.282893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:49:13.283326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.283414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.283534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:49:13.283725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:49:13.283828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.284053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.284238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.284323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.284545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 10 20:49:13.284637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.284920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.285238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.285559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.285874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.295839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.296119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.296390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.296673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.297510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.297852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.298183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.298527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.305012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.306805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.308326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.308611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.308896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.309282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.309573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.309836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.310111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.310388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.310660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.310742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.310957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.311076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.311260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.311507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.311955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.312299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.312624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.312954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.313786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.314112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.314442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.314769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.339566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.341224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.341507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.342312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.344024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.344411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.347089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.347390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.347673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.349958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.350301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.350646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.355020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.355327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.358146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.358422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.360017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.360327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.360595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.360874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.361145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.361414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.361684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.361952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.363167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.363455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.363737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.364018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.364291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.364562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.364830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.365096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.381254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.381534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.384384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.384661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.386037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.389210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.389660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.389961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.393511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.393752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.395514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.398727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.399082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.402362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.402804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.403102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.403406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.403687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.403962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.404240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.406103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.406399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.406681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.407027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.407374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.407650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.423620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.423992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.424262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.424530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.426953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.427356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.427628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.427893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.432436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.434159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.434434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.435837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.437525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.437610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.437803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.437898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.438662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.438953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.439259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.441421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.441744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.442035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.442321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.442594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.452653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.452935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.453218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.453517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.453937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.454227 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.454509 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.456346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.456624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.456907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.457193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.457467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.457747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.458018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.473136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.476449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.476681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.479793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.479959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.481399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.483029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.483283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.483375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.483635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.484875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.486563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.486835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.487140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.491463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.493070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.494523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.496149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.496341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.496633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.496919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.497209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.499375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.499663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.499942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.500225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.506992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.507315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.507600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.509900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.510191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.510468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.515666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80290) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.515949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.516297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.516572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.516857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.517142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.517417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.517692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.517962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.518229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.518500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.518780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.518900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80291) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 10 20:49:13.519046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.519198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.519330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80290) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.519474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.519746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.520024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.520304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.520573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.520846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.521112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.521378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.521648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.521925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.522186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.522440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80291) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 10 20:49:13.558952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd7b0899c0 pid: 80290 (default app) May 10 20:49:13.562016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fd7b0899c0 pid: 80291 (default app) May 10 20:49:13.562342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ad9d4-66fc-41e2-80b6-62e5f1129309 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:13.562634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ad9d4-66fc-41e2-80b6-62e5f1129309 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:13.562923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ad9d4-66fc-41e2-80b6-62e5f1129309 None None] PATH_INFO: `/v3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:13.567366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Tue May 10 20:49:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:22.695366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19d75-060c-4513-9f36-b9a6c667f6f6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:22.696294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19d75-060c-4513-9f36-b9a6c667f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:22.696294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a19d75-060c-4513-9f36-b9a6c667f6f6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:22.700427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:22.706361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:22.706808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:22.706902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:22.739279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG oslo_db.sqlalchemy.engines [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:49:22.940518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80290) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 20:49:22.940850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG passlib.handlers.bcrypt [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80290) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 20:49:22.996195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:22.997813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:23.123915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 20:49:23.282211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19d75-060c-4513-9f36-b9a6c667f6f6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:23.318237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG oslo_db.sqlalchemy.engines [None req-d5a19d75-060c-4513-9f36-b9a6c667f6f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80291) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 20:49:23.455292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a19d75-060c-4513-9f36-b9a6c667f6f6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:23.459655 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47c355-7fd8-47f2-8bdd-1818d6602f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:23.460319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c355-7fd8-47f2-8bdd-1818d6602f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:23.460606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c355-7fd8-47f2-8bdd-1818d6602f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:23.460885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47c355-7fd8-47f2-8bdd-1818d6602f9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:23.468970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47c355-7fd8-47f2-8bdd-1818d6602f9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:23.520746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5a47c355-7fd8-47f2-8bdd-1818d6602f9a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 20:49:23.521176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47c355-7fd8-47f2-8bdd-1818d6602f9a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:23.531966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Tue May 10 20:49:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:49:23.538078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:23.553557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87261eb1-99e4-4128-8d5d-8f9319bd4250 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:23.558062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2827e-6b50-4ec5-befc-7a79f0ac5117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:23.559251 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2827e-6b50-4ec5-befc-7a79f0ac5117 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:23.559537 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2827e-6b50-4ec5-befc-7a79f0ac5117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:23.559812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2827e-6b50-4ec5-befc-7a79f0ac5117 admin admin] PATH_INFO: `/v3/projects/0505b6fc7edf412485d1ca7159b626ae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:23.561331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2827e-6b50-4ec5-befc-7a79f0ac5117 admin admin] RBAC: Authorizing `identity:get_project(project_id=0505b6fc7edf412485d1ca7159b626ae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:23.612596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING keystone.common.rbac_enforcer.enforcer [None req-56c2827e-6b50-4ec5-befc-7a79f0ac5117 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 10 20:49:23.612945 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2827e-6b50-4ec5-befc-7a79f0ac5117 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:23.617681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Tue May 10 20:49:23 2022] GET /identity/v3/projects/0505b6fc7edf412485d1ca7159b626ae => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:25.813568 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570de339-839d-4095-8162-6e94c76743d2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:25.814112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570de339-839d-4095-8162-6e94c76743d2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:25.814216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570de339-839d-4095-8162-6e94c76743d2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:25.818420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:25.824192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f4ca-9cb3-4649-9dc7-cc2f05f662ae None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:25.824620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f4ca-9cb3-4649-9dc7-cc2f05f662ae None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:25.824755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb27f4ca-9cb3-4649-9dc7-cc2f05f662ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:25.846240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-eb27f4ca-9cb3-4649-9dc7-cc2f05f662ae None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:25.847786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eb27f4ca-9cb3-4649-9dc7-cc2f05f662ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:25.855721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 10 20:49:25.878579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570de339-839d-4095-8162-6e94c76743d2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:25.890366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570de339-839d-4095-8162-6e94c76743d2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:25.895613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98170e0-9e02-4cdd-a220-fe073b903508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:25.896243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98170e0-9e02-4cdd-a220-fe073b903508 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:25.896524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98170e0-9e02-4cdd-a220-fe073b903508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:25.896799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98170e0-9e02-4cdd-a220-fe073b903508 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:25.904397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98170e0-9e02-4cdd-a220-fe073b903508 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:25.906159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98170e0-9e02-4cdd-a220-fe073b903508 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:25.915230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Tue May 10 20:49:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 20:49:25.920766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f4ca-9cb3-4649-9dc7-cc2f05f662ae None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:25.929915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb27f4ca-9cb3-4649-9dc7-cc2f05f662ae None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:25.934377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8f3aa-0460-43cf-9045-bc3bddf87b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:25.935270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f3aa-0460-43cf-9045-bc3bddf87b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:25.935555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f3aa-0460-43cf-9045-bc3bddf87b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:25.935831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8f3aa-0460-43cf-9045-bc3bddf87b93 admin admin] PATH_INFO: `/v3/users/b4075d4b32a74f3abd78c38a5335cfb6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:25.937216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f3aa-0460-43cf-9045-bc3bddf87b93 admin admin] RBAC: Authorizing `identity:get_user(user_id=b4075d4b32a74f3abd78c38a5335cfb6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:25.939687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8f3aa-0460-43cf-9045-bc3bddf87b93 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:25.941445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Tue May 10 20:49:25 2022] GET /identity/v3/users/b4075d4b32a74f3abd78c38a5335cfb6 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:28.215944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49a7d-3173-4c82-b642-078e6c1d079a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.216484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49a7d-3173-4c82-b642-078e6c1d079a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.216484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49a7d-3173-4c82-b642-078e6c1d079a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.217828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:28.223747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268b97-0589-4ba1-8dad-a06afe3e2c75 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.224168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268b97-0589-4ba1-8dad-a06afe3e2c75 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.224375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268b97-0589-4ba1-8dad-a06afe3e2c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.308734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709569-d4f5-43ca-8431-a060264bccf7 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.309021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709569-d4f5-43ca-8431-a060264bccf7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.309296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709569-d4f5-43ca-8431-a060264bccf7 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.310654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:28.316619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.316903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.317176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.351038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fc268b97-0589-4ba1-8dad-a06afe3e2c75 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:28.352265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fc268b97-0589-4ba1-8dad-a06afe3e2c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:28.357667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG passlib.handlers.bcrypt [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80291) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 10 20:49:28.358088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG passlib.handlers.bcrypt [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80291) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 10 20:49:28.404972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:28.406541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:28.430409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:28.453035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268b97-0589-4ba1-8dad-a06afe3e2c75 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:28.505701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:49:28.527823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:28.551505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268b97-0589-4ba1-8dad-a06afe3e2c75 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:28.583999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:28.584780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.585064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.585342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.597123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:28.608278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:28.609359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:28.610626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:49:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:28.615298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:28.631671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c758ca-c72f-4880-aae9-424bb223440a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:28.664755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:28.665654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.665941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.666220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.711220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91a67-ffe5-4d82-ae13-0aad5afa65f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:28.732335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:28.733862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:28.743442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:28.744108 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.744393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.744668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.745444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:28.745745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:28.747152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:28.759292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:28.764641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:28.830510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:49:28.835908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:28.858823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084eada-827f-47ef-ad9c-0744425a7db6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:28.894875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:28.895781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.896064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.896346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] PATH_INFO: `/v3/users/b4075d4b32a74f3abd78c38a5335cfb6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:28.897557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] RBAC: Authorizing `identity:get_user(user_id=b4075d4b32a74f3abd78c38a5335cfb6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:28.899035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:28.900851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:28 2022] GET /identity/v3/users/b4075d4b32a74f3abd78c38a5335cfb6 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:28.906150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:28.933428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3e9b9-31b9-476a-a3d2-c2adba41939f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:28.965449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:28.966242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:28.966525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:28.966801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:29.002858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fc665-8b9c-4c78-ac79-10e076f688f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:29.038085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:29.038841 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:29.039140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:29.039418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:29.040643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:29.042112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:29.043794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:29.050115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:29.098372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:29.099866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:49:29.120777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:29.121616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:29.122429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:49:29.122429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:49:29.122429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:49:29.122429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:29.122429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:29.128987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:29.147928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9536e0e-8ebd-41d3-9c39-4899dd712fb4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:29.180432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f423e-4610-4751-aeed-8f7b2e15bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:29.181086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f423e-4610-4751-aeed-8f7b2e15bd29 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:29.181372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f423e-4610-4751-aeed-8f7b2e15bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:29.181652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f423e-4610-4751-aeed-8f7b2e15bd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:29.182495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f423e-4610-4751-aeed-8f7b2e15bd29 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.domain.id=default, user.id=b4075d4b32a74f3abd78c38a5335cfb6) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:29.182813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f423e-4610-4751-aeed-8f7b2e15bd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:29.184320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f423e-4610-4751-aeed-8f7b2e15bd29 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:29.191405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Tue May 10 20:49:29 2022] GET /identity/v3/role_assignments?user.id=b4075d4b32a74f3abd78c38a5335cfb6&scope.domain.id=default&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:29.230605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd6c87c-740c-494d-a4e8-89c2847c4dd3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:29.267724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504946b-cf11-4d0b-aabb-44018f94f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:29.268435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504946b-cf11-4d0b-aabb-44018f94f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:29.268705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504946b-cf11-4d0b-aabb-44018f94f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:29.268984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504946b-cf11-4d0b-aabb-44018f94f5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:29.269741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504946b-cf11-4d0b-aabb-44018f94f5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:29.270050 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504946b-cf11-4d0b-aabb-44018f94f5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:29.271496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504946b-cf11-4d0b-aabb-44018f94f5b8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:29.290132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:49:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:31.604341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b4643-7925-4786-8afc-6b36048b460a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:31.604840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b4643-7925-4786-8afc-6b36048b460a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:31.604939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b4643-7925-4786-8afc-6b36048b460a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:31.606586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:31.620859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c450d-464a-4fd2-95e2-501a3191dfca None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:31.621797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c450d-464a-4fd2-95e2-501a3191dfca None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:31.622268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c450d-464a-4fd2-95e2-501a3191dfca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:31.645585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fb4c450d-464a-4fd2-95e2-501a3191dfca None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:31.646870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fb4c450d-464a-4fd2-95e2-501a3191dfca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:31.741956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:31.783799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b4643-7925-4786-8afc-6b36048b460a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:31.894928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb68b-69e8-4feb-97fc-81aadb57c478 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:31.895178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb68b-69e8-4feb-97fc-81aadb57c478 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:31.895445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb68b-69e8-4feb-97fc-81aadb57c478 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:31.896979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 12/24] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:31.904485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80a10-049a-4eb7-a860-9c18fe9cd4e4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:31.905026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80a10-049a-4eb7-a860-9c18fe9cd4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:31.905480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a80a10-049a-4eb7-a860-9c18fe9cd4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:31.921641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b4643-7925-4786-8afc-6b36048b460a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:31.943432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-96a80a10-049a-4eb7-a860-9c18fe9cd4e4 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:31.944955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-96a80a10-049a-4eb7-a860-9c18fe9cd4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:32.003854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:32.004658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.005100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.005514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.015019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 13/25] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:49:32.028607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:32.045246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:32.046127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:32.046873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 13/26] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:49:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:32.054631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a80a10-049a-4eb7-a860-9c18fe9cd4e4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:32.054769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:32.228146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a80a10-049a-4eb7-a860-9c18fe9cd4e4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:32.251072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9028f-22e4-4987-b0f5-95e88d30a85a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:32.271968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:32.272659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.272944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.273220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.273990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:32.274296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:32.275725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:32.297751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca71973-9b68-4eb3-94d5-914eb313983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:32.298161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 14/27] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:32.298538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71973-9b68-4eb3-94d5-914eb313983f None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.298819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71973-9b68-4eb3-94d5-914eb313983f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.299092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca71973-9b68-4eb3-94d5-914eb313983f None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.299884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca71973-9b68-4eb3-94d5-914eb313983f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:32.302079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:32.302656 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca71973-9b68-4eb3-94d5-914eb313983f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:32.445984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0dd421-88e1-4de8-b695-db2deed7da8d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:32.501427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:32.502698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.503232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.503733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] PATH_INFO: `/v3/users/b4075d4b32a74f3abd78c38a5335cfb6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.508560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] RBAC: Authorizing `identity:get_user(user_id=b4075d4b32a74f3abd78c38a5335cfb6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:32.510402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:32.512455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 15/28] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:32 2022] GET /identity/v3/users/b4075d4b32a74f3abd78c38a5335cfb6 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:32.518975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:32.599919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 14/29] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 20:49:32 2022] POST /identity/v3/roles => generated 219 bytes in 545 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:49:32.601521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5716a-cbc0-4457-b5df-37a7143b0c08 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.601977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5716a-cbc0-4457-b5df-37a7143b0c08 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.602418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5716a-cbc0-4457-b5df-37a7143b0c08 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.604220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 15/30] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:32.619819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af101-212d-4aa8-8c1e-d5b89cb92dc4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.619819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af101-212d-4aa8-8c1e-d5b89cb92dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.619819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102af101-212d-4aa8-8c1e-d5b89cb92dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.626314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81beebe5-9e08-45a7-8d10-385a4dfd420b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:32.660646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-102af101-212d-4aa8-8c1e-d5b89cb92dc4 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:32.662440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-102af101-212d-4aa8-8c1e-d5b89cb92dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:32.674033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab92f44-596e-4b8d-9b44-333ac9c96481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:32.674863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92f44-596e-4b8d-9b44-333ac9c96481 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.675176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92f44-596e-4b8d-9b44-333ac9c96481 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.675466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab92f44-596e-4b8d-9b44-333ac9c96481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.680056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab92f44-596e-4b8d-9b44-333ac9c96481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:32.681599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab92f44-596e-4b8d-9b44-333ac9c96481 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:32.683748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:32.685053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ee0a-9eec-4a96-8977-fb46f2e0e286 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.685343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ee0a-9eec-4a96-8977-fb46f2e0e286 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.685625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ee0a-9eec-4a96-8977-fb46f2e0e286 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.687136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 17/32] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:32.692310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ee0a-9eec-4a96-8977-fb46f2e0e286 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:32.828007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 16/33] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:32.828007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965b02-d2cc-40b2-9db6-c2b4d45d41de None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.828007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965b02-d2cc-40b2-9db6-c2b4d45d41de None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.828007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f965b02-d2cc-40b2-9db6-c2b4d45d41de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.836789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ee0a-9eec-4a96-8977-fb46f2e0e286 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:32.847599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1f965b02-d2cc-40b2-9db6-c2b4d45d41de None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:32.849111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f965b02-d2cc-40b2-9db6-c2b4d45d41de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:32.873252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:32.874141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:32.874590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:32.875020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] PATH_INFO: `/v3/domains/default/users/b4075d4b32a74f3abd78c38a5335cfb6/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:32.878171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b4075d4b32a74f3abd78c38a5335cfb6, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:32.879912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:32.935022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 17/34] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:32.936244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965b02-d2cc-40b2-9db6-c2b4d45d41de None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:33.051098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f965b02-d2cc-40b2-9db6-c2b4d45d41de None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:33.086845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:33.087519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.087857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.088145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.088968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:33.090602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:33.131904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 18/35] 10.222.0.49 () {58 vars in 1361 bytes} [Tue May 10 20:49:32 2022] PUT /identity/v3/domains/default/users/b4075d4b32a74f3abd78c38a5335cfb6/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:49:33.135181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:33.174625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 18/36] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 20:49:32 2022] POST /identity/v3/roles => generated 225 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:49:33.263110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24096-f350-42be-968a-05018ede9257 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:33.304355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae44c3-b548-4f41-98ca-e7b54d762bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:33.305539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae44c3-b548-4f41-98ca-e7b54d762bea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.306069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae44c3-b548-4f41-98ca-e7b54d762bea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.306527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae44c3-b548-4f41-98ca-e7b54d762bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.321275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae44c3-b548-4f41-98ca-e7b54d762bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:33.324067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae44c3-b548-4f41-98ca-e7b54d762bea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e3ae44c3-b548-4f41-98ca-e7b54d762bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:49:33.346613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:33.347520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:33.348423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:49:33.348423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:49:33.348423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:49:33.348423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:33.350196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 19/37] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:33.360379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:33.511758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad247e-59be-4894-94c7-244dc643be2c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:33.555514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:33.556185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.556467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.556741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.557472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:33.557779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:33.559203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:33.564657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9f447-17b0-411d-8a4e-01788ff63082 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.565219 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9f447-17b0-411d-8a4e-01788ff63082 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.565715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9f447-17b0-411d-8a4e-01788ff63082 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.571548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 20/38] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:33.578584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe7ac-20fa-46d0-a145-975830adf0bc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.579215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe7ac-20fa-46d0-a145-975830adf0bc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.579691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fe7ac-20fa-46d0-a145-975830adf0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.585691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 19/39] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:33.591354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:33.603684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f24fe7ac-20fa-46d0-a145-975830adf0bc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:33.605255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f24fe7ac-20fa-46d0-a145-975830adf0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:33.695577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 21/40] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:49:33.707676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3cb43-d95a-4023-a447-41ce6dd1fdd2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:33.717927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fe7ac-20fa-46d0-a145-975830adf0bc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:33.748208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694b62f-de3d-4bd3-a410-ee72c6031caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:33.748902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b62f-de3d-4bd3-a410-ee72c6031caf None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.749346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b62f-de3d-4bd3-a410-ee72c6031caf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.749643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b62f-de3d-4bd3-a410-ee72c6031caf None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.750859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694b62f-de3d-4bd3-a410-ee72c6031caf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:33.752496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694b62f-de3d-4bd3-a410-ee72c6031caf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:33.822566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fe7ac-20fa-46d0-a145-975830adf0bc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:33.858473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:33.859078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.859399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.859725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.861739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:33.861935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:33.867536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:49:33 2022] POST /identity/v3/projects => generated 301 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:49:33.867536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a161-2b32-423b-917b-027962b4e3fc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.867536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a161-2b32-423b-917b-027962b4e3fc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.867536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4a161-2b32-423b-917b-027962b4e3fc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.867536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 21/42] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:33.872910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee38ac-6e3d-4f12-9da6-dfd4351dec81 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:33.873198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee38ac-6e3d-4f12-9da6-dfd4351dec81 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:33.873483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee38ac-6e3d-4f12-9da6-dfd4351dec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:33.893466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ccee38ac-6e3d-4f12-9da6-dfd4351dec81 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:33.894847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ccee38ac-6e3d-4f12-9da6-dfd4351dec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:33.949064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 22/43] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 20:49:33 2022] POST /identity/v3/roles => generated 223 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:49:33.979688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 22/44] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:34.006301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:34.123257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf32238-8601-4556-adf3-b81164028c07 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:34.161636 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95115c78-e681-4cb8-816b-a9a8a190eb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:34.162448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95115c78-e681-4cb8-816b-a9a8a190eb37 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:34.162741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95115c78-e681-4cb8-816b-a9a8a190eb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:34.163023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95115c78-e681-4cb8-816b-a9a8a190eb37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:34.164266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95115c78-e681-4cb8-816b-a9a8a190eb37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:34.165737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95115c78-e681-4cb8-816b-a9a8a190eb37 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:34.167561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 23/45] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:34.174122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee38ac-6e3d-4f12-9da6-dfd4351dec81 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:34.273884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee38ac-6e3d-4f12-9da6-dfd4351dec81 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:34.306047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c069171-c82e-4483-a996-dea4d44537a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:34.306704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069171-c82e-4483-a996-dea4d44537a7 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:34.306986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069171-c82e-4483-a996-dea4d44537a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:34.307296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c069171-c82e-4483-a996-dea4d44537a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:34.308004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069171-c82e-4483-a996-dea4d44537a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:34.309470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c069171-c82e-4483-a996-dea4d44537a7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:34.387987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:49:34 2022] POST /identity/v3/projects => generated 312 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:49:35.598214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4a78f-f305-4384-85e4-d995e6ae8585 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:35.598738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4a78f-f305-4384-85e4-d995e6ae8585 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:35.598819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4a78f-f305-4384-85e4-d995e6ae8585 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:35.600360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 24/47] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:35.605737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04f21-3a31-4932-8905-7d767ecf3ee9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:35.606108 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04f21-3a31-4932-8905-7d767ecf3ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:35.606297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04f21-3a31-4932-8905-7d767ecf3ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:35.623350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f5f04f21-3a31-4932-8905-7d767ecf3ee9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:35.624524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5f04f21-3a31-4932-8905-7d767ecf3ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:35.689992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 24/48] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:35.712549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4a78f-f305-4384-85e4-d995e6ae8585 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:35.810164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4a78f-f305-4384-85e4-d995e6ae8585 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:35.840843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:35.841620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:35.841905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:35.842183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:35.854495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:35.863788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:35.864740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:35.865502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 25/49] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:35.871940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f04f21-3a31-4932-8905-7d767ecf3ee9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:35.965707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f04f21-3a31-4932-8905-7d767ecf3ee9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:35.999174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:35.999843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:36.000127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:36.000438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:36.001302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:36.001613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:36.003011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:36.011182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 25/50] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:36.016902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:36.113155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1235a1-6dee-4cac-810a-df9114a1fd49 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:36.145116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:36.145985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:36.146353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:36.146849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] PATH_INFO: `/v3/users/b4075d4b32a74f3abd78c38a5335cfb6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:36.148518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] RBAC: Authorizing `identity:get_user(user_id=b4075d4b32a74f3abd78c38a5335cfb6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:36.149951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:36.151608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 26/51] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:36 2022] GET /identity/v3/users/b4075d4b32a74f3abd78c38a5335cfb6 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:36.156949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:36.256665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76175aa-c530-4e5f-bb19-4f0db7fb12f0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:36.289598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe92eadc-4d9f-4195-bf09-1f0d1543049b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:36.290389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92eadc-4d9f-4195-bf09-1f0d1543049b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:36.290681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92eadc-4d9f-4195-bf09-1f0d1543049b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:36.290960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe92eadc-4d9f-4195-bf09-1f0d1543049b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:36.292169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92eadc-4d9f-4195-bf09-1f0d1543049b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:36.293630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe92eadc-4d9f-4195-bf09-1f0d1543049b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:36.295575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 26/52] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:36.301564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:36.397539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47632d-294a-4ea3-b897-3bb196433991 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:36.429631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6546c6f-d3de-406a-ad6b-e5abfd463b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:36.430284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6546c6f-d3de-406a-ad6b-e5abfd463b36 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:36.430579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6546c6f-d3de-406a-ad6b-e5abfd463b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:36.430861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6546c6f-d3de-406a-ad6b-e5abfd463b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:36.431734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6546c6f-d3de-406a-ad6b-e5abfd463b36 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.domain.id=default, user.id=b4075d4b32a74f3abd78c38a5335cfb6) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:36.432049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6546c6f-d3de-406a-ad6b-e5abfd463b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:36.433478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6546c6f-d3de-406a-ad6b-e5abfd463b36 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:36.442141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 27/53] 10.222.0.49 () {56 vars in 1322 bytes} [Tue May 10 20:49:36 2022] GET /identity/v3/role_assignments?user.id=b4075d4b32a74f3abd78c38a5335cfb6&scope.domain.id=default&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:36.652352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615ba68-ef52-4df3-9a75-d682567acfff None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:36.652833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615ba68-ef52-4df3-9a75-d682567acfff None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:36.652833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615ba68-ef52-4df3-9a75-d682567acfff None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:36.654206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 27/54] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:36.659757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53e5ea-b524-44a4-89bd-37834ae424ec None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:36.660177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53e5ea-b524-44a4-89bd-37834ae424ec None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:36.660322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc53e5ea-b524-44a4-89bd-37834ae424ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:36.677333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cc53e5ea-b524-44a4-89bd-37834ae424ec None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:36.678534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cc53e5ea-b524-44a4-89bd-37834ae424ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:36.744063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 28/55] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:36.767968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615ba68-ef52-4df3-9a75-d682567acfff None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:36.865383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615ba68-ef52-4df3-9a75-d682567acfff None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:36.897160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b176cb-3c36-4252-bb03-6fbf15907c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:36.897941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b176cb-3c36-4252-bb03-6fbf15907c70 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:36.898225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b176cb-3c36-4252-bb03-6fbf15907c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:36.898504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b176cb-3c36-4252-bb03-6fbf15907c70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:36.899688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b176cb-3c36-4252-bb03-6fbf15907c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:36.901121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b176cb-3c36-4252-bb03-6fbf15907c70 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:36.902758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 28/56] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:36.908428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53e5ea-b524-44a4-89bd-37834ae424ec None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:37.003494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc53e5ea-b524-44a4-89bd-37834ae424ec None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:37.035527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a36930-953b-4dfe-83f2-54f178a1cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:37.036186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36930-953b-4dfe-83f2-54f178a1cbc7 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:37.036476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36930-953b-4dfe-83f2-54f178a1cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:37.036756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a36930-953b-4dfe-83f2-54f178a1cbc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:37.037481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a36930-953b-4dfe-83f2-54f178a1cbc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:37.038919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a36930-953b-4dfe-83f2-54f178a1cbc7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:37.114600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 29/57] 10.222.0.49 () {60 vars in 1140 bytes} [Tue May 10 20:49:36 2022] POST /identity/v3/projects => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:49:39.325303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12985-6e0a-46b7-8d07-4a31a7fd4116 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:39.325819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12985-6e0a-46b7-8d07-4a31a7fd4116 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:39.325906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12985-6e0a-46b7-8d07-4a31a7fd4116 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:39.327258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 29/58] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:39.333520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf270bc0-0d31-434b-8189-3558e78eb932 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:39.333923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf270bc0-0d31-434b-8189-3558e78eb932 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:39.334086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf270bc0-0d31-434b-8189-3558e78eb932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:39.355100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cf270bc0-0d31-434b-8189-3558e78eb932 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:39.356329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cf270bc0-0d31-434b-8189-3558e78eb932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:39.429946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 30/59] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:39.456700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12985-6e0a-46b7-8d07-4a31a7fd4116 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:39.553226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12985-6e0a-46b7-8d07-4a31a7fd4116 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:39.585349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3522a1-3b89-436c-b130-6e879259270a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:39.586064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3522a1-3b89-436c-b130-6e879259270a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:39.586351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3522a1-3b89-436c-b130-6e879259270a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:39.586630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3522a1-3b89-436c-b130-6e879259270a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:39.587864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3522a1-3b89-436c-b130-6e879259270a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:39.589311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3522a1-3b89-436c-b130-6e879259270a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:39.590902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 30/60] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:39.596603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf270bc0-0d31-434b-8189-3558e78eb932 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:39.689476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf270bc0-0d31-434b-8189-3558e78eb932 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:39.723572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a67805-36d9-4981-bbf9-c23a9d3f2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:39.724237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a67805-36d9-4981-bbf9-c23a9d3f2e86 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:39.724521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a67805-36d9-4981-bbf9-c23a9d3f2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:39.724798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a67805-36d9-4981-bbf9-c23a9d3f2e86 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:39.725517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a67805-36d9-4981-bbf9-c23a9d3f2e86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:39.726953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a67805-36d9-4981-bbf9-c23a9d3f2e86 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:39.826964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 31/61] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:49:39 2022] POST /identity/v3/users => generated 275 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:49:43.229281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e83d5f-8149-45da-b9ee-5b8c0c590248 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.230396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e83d5f-8149-45da-b9ee-5b8c0c590248 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.230909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e83d5f-8149-45da-b9ee-5b8c0c590248 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.233121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 31/62] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:43.240164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6cb10-6334-4e1f-bb13-f41e92080805 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.241233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6cb10-6334-4e1f-bb13-f41e92080805 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.241727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6cb10-6334-4e1f-bb13-f41e92080805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.262521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-37f6cb10-6334-4e1f-bb13-f41e92080805 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:43.264111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-37f6cb10-6334-4e1f-bb13-f41e92080805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:43.308558 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ecf-0295-4c27-bbb4-0fe0c6685e62 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.308872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ecf-0295-4c27-bbb4-0fe0c6685e62 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.309123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ecf-0295-4c27-bbb4-0fe0c6685e62 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.310722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 32/63] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:43.315872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760b9f-d75d-46aa-bd44-2920146abc0a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.316165 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760b9f-d75d-46aa-bd44-2920146abc0a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.316445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30760b9f-d75d-46aa-bd44-2920146abc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.344220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-30760b9f-d75d-46aa-bd44-2920146abc0a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:43.345949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-30760b9f-d75d-46aa-bd44-2920146abc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:43.391566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 32/64] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:49:43.428610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd253-bf24-4330-b4a9-2b42c35f236b None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.429249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd253-bf24-4330-b4a9-2b42c35f236b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.429744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd253-bf24-4330-b4a9-2b42c35f236b None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.431631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 33/65] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:43.432622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fd253-bf24-4330-b4a9-2b42c35f236b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:43.459790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 33/66] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:49:43.462398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378f338-b6ec-4efa-88b0-3494f2454597 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.462925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378f338-b6ec-4efa-88b0-3494f2454597 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.463438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378f338-b6ec-4efa-88b0-3494f2454597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.480577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4378f338-b6ec-4efa-88b0-3494f2454597 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:43.482207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4378f338-b6ec-4efa-88b0-3494f2454597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:43.553113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fd253-bf24-4330-b4a9-2b42c35f236b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:43.554098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 34/67] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:43.555289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378f338-b6ec-4efa-88b0-3494f2454597 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:43.601831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:43.603030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.603558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.604053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.615621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:43.623657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:43.624558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:43.625711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 34/68] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:43.626382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:43.666383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378f338-b6ec-4efa-88b0-3494f2454597 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:43.700420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f26ee-0d93-48ca-a1c1-af6dd1fb5bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:43.701231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f26ee-0d93-48ca-a1c1-af6dd1fb5bdd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.701525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f26ee-0d93-48ca-a1c1-af6dd1fb5bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.701803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f26ee-0d93-48ca-a1c1-af6dd1fb5bdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.712223 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f26ee-0d93-48ca-a1c1-af6dd1fb5bdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-112f26ee-0d93-48ca-a1c1-af6dd1fb5bdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:43.720753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:43.721635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:43.722393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 35/69] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:49:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:43.723671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b0bc-04e2-42fd-b293-a0d22536ca48 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.723671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b0bc-04e2-42fd-b293-a0d22536ca48 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.723912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08b0bc-04e2-42fd-b293-a0d22536ca48 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.727229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 36/70] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:43.727229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b0bc-04e2-42fd-b293-a0d22536ca48 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:43.734959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8228f7bd-b08a-4750-8285-4520fe058049 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:43.766341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:43.767171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.767460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.767738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.777772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:43.786372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:43.787289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:43.788051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:49:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:43.789199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:43.835290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08b0bc-04e2-42fd-b293-a0d22536ca48 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:43.869615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de623ec3-568d-4c45-9c21-b63e86948286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:43.870287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623ec3-568d-4c45-9c21-b63e86948286 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.870569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623ec3-568d-4c45-9c21-b63e86948286 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.870840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de623ec3-568d-4c45-9c21-b63e86948286 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.871617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de623ec3-568d-4c45-9c21-b63e86948286 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:43.871925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de623ec3-568d-4c45-9c21-b63e86948286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:43.873329 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de623ec3-568d-4c45-9c21-b63e86948286 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:43.883026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 37/72] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:43.884372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195bbb9-f544-4330-96a6-0c5de760dcf0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.884672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195bbb9-f544-4330-96a6-0c5de760dcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.884956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195bbb9-f544-4330-96a6-0c5de760dcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.894635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ede669-e284-437e-89d9-d7a8a45d0e80 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:43.901438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2195bbb9-f544-4330-96a6-0c5de760dcf0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:43.902637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2195bbb9-f544-4330-96a6-0c5de760dcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:43.927917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:43.928600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:43.928887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:43.929166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:43.929951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:43.930244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:43.931683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:43.940760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:43.941579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:43.971884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 38/74] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:43.973267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195bbb9-f544-4330-96a6-0c5de760dcf0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.071030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f904339-beaf-4d62-8637-35d94e158bf7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.079241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195bbb9-f544-4330-96a6-0c5de760dcf0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.112688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.113377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.113661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.113945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.114712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:44.115024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.116467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:44.120939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.121823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.122104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.122381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.124839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:44.130495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.142228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.143870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:44.151010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:43 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:44.151010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.236283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba597e-49d5-4334-af9f-d6d1382d059b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.246971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb0d70-4321-4520-adfe-2af38a1703f2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.268503 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.269377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.269670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.269948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] PATH_INFO: `/v3/users/b4075d4b32a74f3abd78c38a5335cfb6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.271188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b4075d4b32a74f3abd78c38a5335cfb6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.272653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:44.274435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 38/77] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/users/b4075d4b32a74f3abd78c38a5335cfb6 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:44.275144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.284305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.285111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.285401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.285680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.297515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:44.306097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:44.307154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:44.308087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 40/78] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:44.308719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.377117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de6f18-402a-47a1-a0fc-6cdacdae13f0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.414515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df107f-3c90-4d58-9479-fb78fb079b24 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.414772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd90fa-2fd9-4fe5-9e50-dd543fa92916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.415634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd90fa-2fd9-4fe5-9e50-dd543fa92916 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.415929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd90fa-2fd9-4fe5-9e50-dd543fa92916 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.416206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd90fa-2fd9-4fe5-9e50-dd543fa92916 None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.417440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd90fa-2fd9-4fe5-9e50-dd543fa92916 None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.418888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd90fa-2fd9-4fe5-9e50-dd543fa92916 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:44.420932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 39/79] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:44.423325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33332-ec28-4432-af3c-5dc2f6dfe779 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.423325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33332-ec28-4432-af3c-5dc2f6dfe779 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.423538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac33332-ec28-4432-af3c-5dc2f6dfe779 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.424908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 40/80] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:44.425587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac33332-ec28-4432-af3c-5dc2f6dfe779 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.458174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.458848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.459246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.459574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.531862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.534212 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:44.540192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac33332-ec28-4432-af3c-5dc2f6dfe779 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.574489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.575185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.575479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.575767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.641975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 41/81] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:44.642950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.652912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.655572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:44.758768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029db77-89de-473b-aa54-935eeb6b215e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.762088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 41/82] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:44.766721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.798605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04b15e-d64b-41b7-b666-6c9a0e03405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.799381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04b15e-d64b-41b7-b666-6c9a0e03405a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.799672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04b15e-d64b-41b7-b666-6c9a0e03405a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.799956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04b15e-d64b-41b7-b666-6c9a0e03405a None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.800718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04b15e-d64b-41b7-b666-6c9a0e03405a None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:44.801034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04b15e-d64b-41b7-b666-6c9a0e03405a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.802446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04b15e-d64b-41b7-b666-6c9a0e03405a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:44.811173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 42/83] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:44.812257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29491f3-0f02-46e6-abb7-8b67668ef7e3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.812552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29491f3-0f02-46e6-abb7-8b67668ef7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.813474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29491f3-0f02-46e6-abb7-8b67668ef7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.833318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e29491f3-0f02-46e6-abb7-8b67668ef7e3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:44.834567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e29491f3-0f02-46e6-abb7-8b67668ef7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:44.872052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba48b4-5008-483e-b371-51c92b7cafa8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:44.904761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 43/84] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:44.905557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29491f3-0f02-46e6-abb7-8b67668ef7e3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:44.908613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:44.909275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:44.909558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:44.909831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:44.981850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:44.983372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.008299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29491f3-0f02-46e6-abb7-8b67668ef7e3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.042495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.043393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.043675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.043950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.045388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.046831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.049268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 44/85] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.049882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.091481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 42/86] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:45.092165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.145229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee5563-b296-4118-acdd-71f7724db4dc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.179331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.180117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.180404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.180685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.181878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.183399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.185207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 45/87] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.185982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.191800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1256c-57a6-4d53-ae41-7e5972d83d7f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.224978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.225846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.226128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.226403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.227616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.229055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.230665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 43/88] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.231454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.282886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a05db-3859-4de2-be04-d891f11a7fb1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.316712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.317496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.317779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.318054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.319247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.320717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.322298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 46/89] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.323056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.328562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1477-9c3b-4313-9229-1a0d074024d8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.361848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.362499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.362783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.363058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.363916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=0c09c92ec34a444caeb82c56a979d386) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:45.364229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.365654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.371181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 44/90] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/role_assignments?user.id=0c09c92ec34a444caeb82c56a979d386&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.371812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.437940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92d264-2c0b-4cbf-8377-861f893186b5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.475058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.475999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.476289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.476572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.477921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e34446-c2ff-4073-b51b-364798ee69cf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.478055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.479710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.481642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 47/91] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.482329 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.514768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.515487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.516314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.516751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.517615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=b4075d4b32a74f3abd78c38a5335cfb6) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:45.517930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.519421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.531412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 45/92] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/role_assignments?user.id=b4075d4b32a74f3abd78c38a5335cfb6&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.531412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.596399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81471d5-e38e-43a5-8694-08c7142e5433 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.637597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.638326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.638610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.638934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.644374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0c98d-b27a-4e4d-ac9e-f40f0453de19 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.681409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.682115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.682407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.682693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.683537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.685126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.713464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.714883 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.800217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 46/93] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:49:45 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:49:45.801187 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.820811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 48/94] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:45.826722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:45.910676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34541741-d1e9-4eaf-a2c3-8c288426cb0b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.934811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb16e-4d78-4b03-8968-323a4d484c3a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:45.948147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.948987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.949275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.949640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.950600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] RBAC: Adding query filter params (role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=0c09c92ec34a444caeb82c56a979d386) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:45.950989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.952655 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.959247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 47/95] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/role_assignments?user.id=0c09c92ec34a444caeb82c56a979d386&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.982733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb572c11-f6f8-468c-b497-954c8120767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:45.984054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb572c11-f6f8-468c-b497-954c8120767c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:45.984665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb572c11-f6f8-468c-b497-954c8120767c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:45.985188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb572c11-f6f8-468c-b497-954c8120767c None admin] PATH_INFO: `/v3/projects/348ca40a735c43a78c975c6caed75d66` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:45.988114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb572c11-f6f8-468c-b497-954c8120767c None admin] RBAC: Authorizing `identity:get_project(project_id=348ca40a735c43a78c975c6caed75d66)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:45.989717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb572c11-f6f8-468c-b497-954c8120767c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:45.991706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 49/96] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/projects/348ca40a735c43a78c975c6caed75d66 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:45.998023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:46.120290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05c136-a377-4ac3-a4a0-34a232e54aae None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:46.157920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4fc5da-5096-43ab-8bf5-9c331e60ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:46.158603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc5da-5096-43ab-8bf5-9c331e60ce41 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:46.158891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc5da-5096-43ab-8bf5-9c331e60ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:46.159202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4fc5da-5096-43ab-8bf5-9c331e60ce41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:46.160133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fc5da-5096-43ab-8bf5-9c331e60ce41 None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=348ca40a735c43a78c975c6caed75d66, user.id=0c09c92ec34a444caeb82c56a979d386) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:46.160453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fc5da-5096-43ab-8bf5-9c331e60ce41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:46.161971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4fc5da-5096-43ab-8bf5-9c331e60ce41 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:46.168257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 48/97] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:45 2022] GET /identity/v3/role_assignments?user.id=0c09c92ec34a444caeb82c56a979d386&scope.project.id=348ca40a735c43a78c975c6caed75d66&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:48.159405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9abc0-01db-44ba-9184-5088c4f911e4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:48.159925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9abc0-01db-44ba-9184-5088c4f911e4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:48.160001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9abc0-01db-44ba-9184-5088c4f911e4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:48.161605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 50/98] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:48.166983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502288-3ba0-477d-9d7d-c619a9fbbeeb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:48.167495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502288-3ba0-477d-9d7d-c619a9fbbeeb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:48.167577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89502288-3ba0-477d-9d7d-c619a9fbbeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:48.188797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-89502288-3ba0-477d-9d7d-c619a9fbbeeb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:48.190001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-89502288-3ba0-477d-9d7d-c619a9fbbeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:48.218207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47743d-ead3-4626-acbe-c2494b22ea67 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:48.218536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47743d-ead3-4626-acbe-c2494b22ea67 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:48.219320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47743d-ead3-4626-acbe-c2494b22ea67 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:48.220822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 51/99] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:48.226241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dc81-0d88-4558-baff-850b32514c19 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:48.226525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dc81-0d88-4558-baff-850b32514c19 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:48.226804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dc81-0d88-4558-baff-850b32514c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:48.249382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f7d8dc81-0d88-4558-baff-850b32514c19 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:48.251244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f7d8dc81-0d88-4558-baff-850b32514c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:48.310600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 49/100] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:48.355130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502288-3ba0-477d-9d7d-c619a9fbbeeb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:48.384834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 52/101] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:49:48.429103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8dc81-0d88-4558-baff-850b32514c19 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:48.497738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89502288-3ba0-477d-9d7d-c619a9fbbeeb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:48.567479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:48.568292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:48.568582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:48.568864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:48.591821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:48.604287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:48.605215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:48.606004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 50/102] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:48.616355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8dc81-0d88-4558-baff-850b32514c19 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:48.624945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:48.694508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:48.695728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:48.696225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:48.696775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:48.718027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:48.726798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:48.727784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:48.728555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:48.741314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 53/103] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:48.747802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:48.802992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bf464-0c14-4c56-9b13-355863cf8bb9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:48.840008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:48.840964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:48.841445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:48.841872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:48.842828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:48.843316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:48.845384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:48.854239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 51/104] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:48.860758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.016647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382397d6-cada-4620-8728-a3eac2b65adf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.039915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00d7ac-173e-4c92-9908-a5513f95cd70 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.053084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09174f-27a4-4e49-a12e-82a923637059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.054306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09174f-27a4-4e49-a12e-82a923637059 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.054797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09174f-27a4-4e49-a12e-82a923637059 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.055305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09174f-27a4-4e49-a12e-82a923637059 None admin] PATH_INFO: `/v3/users/b4075d4b32a74f3abd78c38a5335cfb6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.056797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09174f-27a4-4e49-a12e-82a923637059 None admin] RBAC: Authorizing `identity:get_user(user_id=b4075d4b32a74f3abd78c38a5335cfb6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:49.058610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09174f-27a4-4e49-a12e-82a923637059 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:49.060591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 52/105] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:48 2022] GET /identity/v3/users/b4075d4b32a74f3abd78c38a5335cfb6 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:49.061978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f861a-998f-4e6c-b605-7f2b24a99615 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.062510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f861a-998f-4e6c-b605-7f2b24a99615 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.063007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f861a-998f-4e6c-b605-7f2b24a99615 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.064593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 53/106] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:49.067911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f861a-998f-4e6c-b605-7f2b24a99615 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.120710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9e331-44b0-4d14-bd4b-5043e9c0943d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.121742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e331-44b0-4d14-bd4b-5043e9c0943d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.122252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e331-44b0-4d14-bd4b-5043e9c0943d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.122728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9e331-44b0-4d14-bd4b-5043e9c0943d None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.123893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9e331-44b0-4d14-bd4b-5043e9c0943d None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:49.124417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9e331-44b0-4d14-bd4b-5043e9c0943d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:49.126930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9e331-44b0-4d14-bd4b-5043e9c0943d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:49.136986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 54/107] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:49.138980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2660-0012-4812-b445-715ce7f38733 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.139693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2660-0012-4812-b445-715ce7f38733 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.140330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b2660-0012-4812-b445-715ce7f38733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.159234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a82b2660-0012-4812-b445-715ce7f38733 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:49.161119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a82b2660-0012-4812-b445-715ce7f38733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:49.223288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f861a-998f-4e6c-b605-7f2b24a99615 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.275396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 55/108] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:49.276421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b2660-0012-4812-b445-715ce7f38733 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.304925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.305878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.306168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.306444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.308953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:49.310832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:49.315655 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 54/109] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:49 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:49.321075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.444536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b2660-0012-4812-b445-715ce7f38733 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.454723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4378af-fe39-4f44-88bf-b11bf9b34acd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.487197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.488099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.488386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.488667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.489924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:49.491418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:49.493464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 56/110] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:49 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:49.494374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.496812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.497729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.498012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.498284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/b4075d4b32a74f3abd78c38a5335cfb6/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.502984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b5422852e4a658bdd2ef28748da83, user_id=b4075d4b32a74f3abd78c38a5335cfb6, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:49.504498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:49.583370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 55/111] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:49:49 2022] PUT /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/b4075d4b32a74f3abd78c38a5335cfb6/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:49:49.584561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.605905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e20e2f-d57c-47a2-98f3-ffd1927269f1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.649542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8314ae-2240-4daf-a4ba-0d80462d49ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.650546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8314ae-2240-4daf-a4ba-0d80462d49ed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.650837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8314ae-2240-4daf-a4ba-0d80462d49ed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.651460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8314ae-2240-4daf-a4ba-0d80462d49ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.668214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8314ae-2240-4daf-a4ba-0d80462d49ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ca8314ae-2240-4daf-a4ba-0d80462d49ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:49.678229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:49.679244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:49.680481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 57/112] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:49:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:49.681375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad384a7-2f07-42ec-ba88-00649689e811 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.681623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad384a7-2f07-42ec-ba88-00649689e811 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.681896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad384a7-2f07-42ec-ba88-00649689e811 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.683429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 58/113] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:49.687754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9edc-c7de-4b37-96f4-435c4b08d97f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.687754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9edc-c7de-4b37-96f4-435c4b08d97f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.687754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe9edc-c7de-4b37-96f4-435c4b08d97f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.687754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 59/114] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:49.688668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9edc-c7de-4b37-96f4-435c4b08d97f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.732860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e11556-dc54-41e4-ba9a-098d056a8d4f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.779842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22aec4-a966-4787-9662-8e0ef09a098b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.780745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22aec4-a966-4787-9662-8e0ef09a098b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.781081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22aec4-a966-4787-9662-8e0ef09a098b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.781942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22aec4-a966-4787-9662-8e0ef09a098b None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.783628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22aec4-a966-4787-9662-8e0ef09a098b None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:49.784975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22aec4-a966-4787-9662-8e0ef09a098b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:49.786841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 56/115] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:49 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:49.792940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04bd3-abd0-41b3-ad24-554ca3dabd1f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.793224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04bd3-abd0-41b3-ad24-554ca3dabd1f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.793510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f04bd3-abd0-41b3-ad24-554ca3dabd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.814217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f5f04bd3-abd0-41b3-ad24-554ca3dabd1f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:49.815474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f5f04bd3-abd0-41b3-ad24-554ca3dabd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:49.824097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe9edc-c7de-4b37-96f4-435c4b08d97f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:49.874662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:49.876467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.876761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.877048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.878004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:49.881799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:49.881799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:49.890407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 57/116] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:49.891978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 60/117] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:49.892894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:49.900237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209137d-c0e4-4066-8241-446b8735be6b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:49.900594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209137d-c0e4-4066-8241-446b8735be6b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:49.900874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209137d-c0e4-4066-8241-446b8735be6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:49.928252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b209137d-c0e4-4066-8241-446b8735be6b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:49.929563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b209137d-c0e4-4066-8241-446b8735be6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:50.008520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 58/118] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:50.016847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209137d-c0e4-4066-8241-446b8735be6b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.024858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d5f0f-02db-492a-966a-0a69fb2ee8c4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.067611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.068572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.068850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.069129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/0c09c92ec34a444caeb82c56a979d386/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.071184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b5422852e4a658bdd2ef28748da83, user_id=0c09c92ec34a444caeb82c56a979d386, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:50.073200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:50.135005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209137d-c0e4-4066-8241-446b8735be6b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.163156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 61/119] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:49:49 2022] PUT /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/0c09c92ec34a444caeb82c56a979d386/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:49:50.163156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.187299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.188922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.189250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.189696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.191405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:50.193660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:50.196663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 59/120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:50.197526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.278778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8669d5-b39a-4720-946d-58df10ead8e2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.319342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fd612-90b5-42d9-84d0-6a04b3776761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.320157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fd612-90b5-42d9-84d0-6a04b3776761 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.320440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fd612-90b5-42d9-84d0-6a04b3776761 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.320717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fd612-90b5-42d9-84d0-6a04b3776761 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.334238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124fd612-90b5-42d9-84d0-6a04b3776761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:50.336343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b864a-b500-4e2b-9719-4da5d824828b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-124fd612-90b5-42d9-84d0-6a04b3776761 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:50.342383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:50.343308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:50.345556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 62/121] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:50.347192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ead804-28b4-4d7a-b068-24f9db0ea420 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.347192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ead804-28b4-4d7a-b068-24f9db0ea420 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.347192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ead804-28b4-4d7a-b068-24f9db0ea420 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.348680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 63/122] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:50.348680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ead804-28b4-4d7a-b068-24f9db0ea420 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.379416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4809b77a-4b65-4b87-aadd-7246c46bf6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.380227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b77a-4b65-4b87-aadd-7246c46bf6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.380563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b77a-4b65-4b87-aadd-7246c46bf6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.380844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4809b77a-4b65-4b87-aadd-7246c46bf6e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.392000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4809b77a-4b65-4b87-aadd-7246c46bf6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4809b77a-4b65-4b87-aadd-7246c46bf6e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:50.399598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:50.400504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:50.401705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 60/123] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:50.402353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f653-f5a7-4aee-a642-79d5a2a49f1e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.402353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f653-f5a7-4aee-a642-79d5a2a49f1e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.402602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560f653-f5a7-4aee-a642-79d5a2a49f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.420647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2560f653-f5a7-4aee-a642-79d5a2a49f1e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:50.421838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2560f653-f5a7-4aee-a642-79d5a2a49f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:50.475918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ead804-28b4-4d7a-b068-24f9db0ea420 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.515693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 61/124] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:50.516413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.517221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f653-f5a7-4aee-a642-79d5a2a49f1e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.517459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.517741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.518017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.519424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:50.520942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:50.522858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 64/125] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:50.527640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.641736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3553d0-8d4d-4309-b253-a874cc05f6b9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.659588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560f653-f5a7-4aee-a642-79d5a2a49f1e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.679891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.680555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.680839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.681114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.681860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:50.682168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:50.683592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:50.693565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 65/126] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:50.694506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.706202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.707492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.709875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.709875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.709875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:50.709875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:50.712300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:50.724135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 62/127] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:50.725494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.804555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1daa-b981-414b-9644-fef2b1e834bc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.846716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d41aa5-1287-49d1-8869-29d46c928903 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:50.848624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.850561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.851025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.851499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/0c09c92ec34a444caeb82c56a979d386/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.854338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b5422852e4a658bdd2ef28748da83, user_id=0c09c92ec34a444caeb82c56a979d386, role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:50.856405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:50.881459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:50.882265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:50.882574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:50.882961 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:50.884053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:50.885491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:50.887349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 63/128] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:50.887908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:50.924124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 66/129] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:49:50 2022] PUT /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/0c09c92ec34a444caeb82c56a979d386/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:49:50.927802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:51.060022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca223b8-011e-4eae-a449-9e15e02c5d6a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:51.133378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e020d82-5734-4e20-9486-86d48e8f5050 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:51.137005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:51.137965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:51.138296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:51.138580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:51.142411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:51.143074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:51.144951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 64/130] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:51.145529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:51.184499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:51.185969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:51.186270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:51.186551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] PATH_INFO: `/v3/users/59acd2c41da849ca8a48ca8787ee3f78` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:51.202224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] RBAC: Authorizing `identity:get_user(user_id=59acd2c41da849ca8a48ca8787ee3f78)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:51.203882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:51.206250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 67/131] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:50 2022] GET /identity/v3/users/59acd2c41da849ca8a48ca8787ee3f78 => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:51.206878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:51.274846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64800967-c4a4-4d4a-83ac-7a660751a475 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:51.308985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:51.309696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:51.309931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:51.310207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:51.310919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:51.312419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:51.320143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd490d3-6b6d-4c2d-8ccb-7f8124c684a1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:51.356208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:51.357131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:51.357417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:51.357696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] PATH_INFO: `/v3/projects/348ca40a735c43a78c975c6caed75d66` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:51.358890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] RBAC: Authorizing `identity:get_project(project_id=348ca40a735c43a78c975c6caed75d66)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:51.360581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:51.362617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 68/132] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:51 2022] GET /identity/v3/projects/348ca40a735c43a78c975c6caed75d66 => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:51.363619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:51.434440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 65/133] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:49:51 2022] POST /identity/v3/projects => generated 302 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:49:51.435387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:51.509594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01ab95-b0f1-4c62-958e-751c99fb98ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:51.573129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:51.573795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:51.574081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:51.574360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:51.685822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6614d-a094-4680-a85d-6ead84d9d450 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:51.715815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:51.718439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:51.757354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:51.759240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:51.763935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:51.764511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] PATH_INFO: `/v3/projects/348ca40a735c43a78c975c6caed75d66/users/0c09c92ec34a444caeb82c56a979d386/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:51.767990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] RBAC: Authorizing `identity:create_grant(project_id=348ca40a735c43a78c975c6caed75d66, user_id=0c09c92ec34a444caeb82c56a979d386, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:51.771282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:51.855678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 66/134] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:49:51 2022] PUT /identity/v3/projects/348ca40a735c43a78c975c6caed75d66/users/0c09c92ec34a444caeb82c56a979d386/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:49:51.867565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 69/135] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:51.876829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:51.989436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e056d8-aff3-47a1-b0f6-724d3df99e69 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:52.029739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce3a46-7ab8-42de-b3ed-73ea311053b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:52.030896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3a46-7ab8-42de-b3ed-73ea311053b9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.031414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3a46-7ab8-42de-b3ed-73ea311053b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.031988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce3a46-7ab8-42de-b3ed-73ea311053b9 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.033433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3a46-7ab8-42de-b3ed-73ea311053b9 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:52.035049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce3a46-7ab8-42de-b3ed-73ea311053b9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:52.037002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 67/136] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:51 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:52.043475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:52.159778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e11f80-f9e2-409a-9034-8e6ae312bc78 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:52.198078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57285dd5-a921-4dbb-92fd-463d1d5621f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:52.199481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285dd5-a921-4dbb-92fd-463d1d5621f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.199939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285dd5-a921-4dbb-92fd-463d1d5621f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.200410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57285dd5-a921-4dbb-92fd-463d1d5621f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.201518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285dd5-a921-4dbb-92fd-463d1d5621f8 None admin] RBAC: Adding query filter params (role.id=b5d48eb189cd4e0da28af8d6f283bef6, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=59acd2c41da849ca8a48ca8787ee3f78) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:52.202016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285dd5-a921-4dbb-92fd-463d1d5621f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:52.204237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57285dd5-a921-4dbb-92fd-463d1d5621f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:52.210748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 70/137] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:52 2022] GET /identity/v3/role_assignments?user.id=59acd2c41da849ca8a48ca8787ee3f78&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=b5d48eb189cd4e0da28af8d6f283bef6 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:52.240627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c407f-3a7d-43fb-9654-2c417c99f6ca None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.241213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c407f-3a7d-43fb-9654-2c417c99f6ca None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.241665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c407f-3a7d-43fb-9654-2c417c99f6ca None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.243275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 68/138] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:52.249171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae619f1-3a15-4c99-8cc6-9c5a0277faf8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.249725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae619f1-3a15-4c99-8cc6-9c5a0277faf8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.250478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae619f1-3a15-4c99-8cc6-9c5a0277faf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.272960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3ae619f1-3a15-4c99-8cc6-9c5a0277faf8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:52.274448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3ae619f1-3a15-4c99-8cc6-9c5a0277faf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:52.362247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 71/139] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:52.395621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c407f-3a7d-43fb-9654-2c417c99f6ca None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:52.521315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c407f-3a7d-43fb-9654-2c417c99f6ca None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:52.556444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:52.557245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.557531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.557861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.569118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:52.576978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:52.577828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:52.579340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 69/140] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:52.585176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae619f1-3a15-4c99-8cc6-9c5a0277faf8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:52.705420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae619f1-3a15-4c99-8cc6-9c5a0277faf8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:52.751857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c67b99-f25c-4262-b9a8-ab6e4dca7c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:52.752571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67b99-f25c-4262-b9a8-ab6e4dca7c3c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.752862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67b99-f25c-4262-b9a8-ab6e4dca7c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.753172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c67b99-f25c-4262-b9a8-ab6e4dca7c3c None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.753931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67b99-f25c-4262-b9a8-ab6e4dca7c3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:52.754241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67b99-f25c-4262-b9a8-ab6e4dca7c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:52.755668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c67b99-f25c-4262-b9a8-ab6e4dca7c3c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:52.764609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 72/141] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:52.770138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:52.837422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27de9a-bd24-4655-8b20-08ba24df57c6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.837731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27de9a-bd24-4655-8b20-08ba24df57c6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.837999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e27de9a-bd24-4655-8b20-08ba24df57c6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.839575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 73/142] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:52.857433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990009-a680-4872-aa0a-cae2a4646c47 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:52.857726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990009-a680-4872-aa0a-cae2a4646c47 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:52.858056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41990009-a680-4872-aa0a-cae2a4646c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:52.892436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-41990009-a680-4872-aa0a-cae2a4646c47 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:52.893659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-41990009-a680-4872-aa0a-cae2a4646c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:52.940075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184aa46-d07f-4b5c-9374-5f0f214decc4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:53.017164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 74/143] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:53.025305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:53.026471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:53.026956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:53.027481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] PATH_INFO: `/v3/users/b4075d4b32a74f3abd78c38a5335cfb6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:53.032392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] RBAC: Authorizing `identity:get_user(user_id=b4075d4b32a74f3abd78c38a5335cfb6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:53.034103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:53.036011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 70/144] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:52 2022] GET /identity/v3/users/b4075d4b32a74f3abd78c38a5335cfb6 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:53.041391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990009-a680-4872-aa0a-cae2a4646c47 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:53.058698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:53.204625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41990009-a680-4872-aa0a-cae2a4646c47 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:53.272284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd2926-07ec-48a1-9e7b-a75134f92c5e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:53.274595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:53.275511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:53.276022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:53.276498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:53.345457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:53.346629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:53.347150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:53.351903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:53.368242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:53.381361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:53.382260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:53.383066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 71/145] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:53.389246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:53.453275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:53.455737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:53.513457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d867f-1553-411c-87fd-9d6ceb220e81 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:53.558397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:53.559031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:53.559294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:53.559573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:53.560348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:53.560658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:53.562194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:53.571843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 72/146] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:53.578481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:53.680516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c665e1f-13e1-4f07-bfed-e7dfbb527c3b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:53.704045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 75/147] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:53.709688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:53.715906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:53.716965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:53.717393 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:53.717807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:53.719687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:53.721346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:53.723155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 73/148] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:53 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:53.728790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:53.907278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce6b84-24ac-4d13-a28e-6b340b21c1f9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:53.954763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d087b28-5937-4a98-bbde-3df3f385c42c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:53.980481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49d46-a048-4a4c-8406-ffe65dfc452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:53.981076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49d46-a048-4a4c-8406-ffe65dfc452b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:53.981367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49d46-a048-4a4c-8406-ffe65dfc452b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:53.981648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49d46-a048-4a4c-8406-ffe65dfc452b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.043845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:54.044982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.045265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.045546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.047360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:54.049186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:54.051094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 76/149] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:53 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:54.058086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:54.106714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49d46-a048-4a4c-8406-ffe65dfc452b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:54.108231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49d46-a048-4a4c-8406-ffe65dfc452b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:54.217643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f08ea-6f0e-46b4-80e4-a3f242e60ea5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:54.267943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e330e-4c8b-45dd-9ad3-76b116dc765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:54.268555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e330e-4c8b-45dd-9ad3-76b116dc765a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.268851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e330e-4c8b-45dd-9ad3-76b116dc765a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.269137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e330e-4c8b-45dd-9ad3-76b116dc765a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.270000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e330e-4c8b-45dd-9ad3-76b116dc765a None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=b4075d4b32a74f3abd78c38a5335cfb6) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:54.270324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e330e-4c8b-45dd-9ad3-76b116dc765a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:54.271816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e330e-4c8b-45dd-9ad3-76b116dc765a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:54.278430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 77/150] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:54 2022] GET /identity/v3/role_assignments?user.id=b4075d4b32a74f3abd78c38a5335cfb6&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:54.282998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab774f0-503c-46f6-8428-3549478d8e01 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.283334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab774f0-503c-46f6-8428-3549478d8e01 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.283625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab774f0-503c-46f6-8428-3549478d8e01 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.285136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 78/151] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:54.289485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 74/152] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:49:54.295524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab774f0-503c-46f6-8428-3549478d8e01 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:54.296711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0ef9-eb7e-40b1-9319-329f85513715 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.297037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0ef9-eb7e-40b1-9319-329f85513715 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.297334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c0ef9-eb7e-40b1-9319-329f85513715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.326118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-473c0ef9-eb7e-40b1-9319-329f85513715 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:54.327201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-473c0ef9-eb7e-40b1-9319-329f85513715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:54.397689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 75/153] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:54.420491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c0ef9-eb7e-40b1-9319-329f85513715 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:54.525571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab774f0-503c-46f6-8428-3549478d8e01 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:54.558913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c0ef9-eb7e-40b1-9319-329f85513715 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:54.598893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:54.600504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.601325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.602218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.610372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:54.611618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.612040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.612455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.615894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:54.616857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:54.618818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 79/154] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:54 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:54.624093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:54.627110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:54.637734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:54.638696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:54.639517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:54.645673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 76/155] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:49:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:54.655638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:54.789444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88c6d3-a7b5-43bf-8453-55684540ee09 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:54.808193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a62aee-2204-4792-b8af-107a51fddecf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:54.843005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:54.843775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.844569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.845877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.846645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:54.846952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:54.848358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:54.857215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 77/156] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:49:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:54.864400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:54.868347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de42f58-1ceb-454c-8c76-386ac6e9593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:54.869029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42f58-1ceb-454c-8c76-386ac6e9593f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.869360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42f58-1ceb-454c-8c76-386ac6e9593f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.869643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de42f58-1ceb-454c-8c76-386ac6e9593f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.870489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42f58-1ceb-454c-8c76-386ac6e9593f None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=0c09c92ec34a444caeb82c56a979d386) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:54.870801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42f58-1ceb-454c-8c76-386ac6e9593f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:54.872297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de42f58-1ceb-454c-8c76-386ac6e9593f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:54.885112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 80/157] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:54 2022] GET /identity/v3/role_assignments?user.id=0c09c92ec34a444caeb82c56a979d386&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:54.958720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf71e2-bfae-4393-afe5-f17ac7cd1aac None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.959030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf71e2-bfae-4393-afe5-f17ac7cd1aac None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.959300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf71e2-bfae-4393-afe5-f17ac7cd1aac None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.960791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 81/158] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:54.966879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918960c3-ab79-4083-ba87-ed78bfa79d55 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:54.967208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918960c3-ab79-4083-ba87-ed78bfa79d55 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:54.967455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918960c3-ab79-4083-ba87-ed78bfa79d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:54.981521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736816e2-15dc-40ab-b5cb-dfe2df00bdd5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:54.987888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-918960c3-ab79-4083-ba87-ed78bfa79d55 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:54.989440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-918960c3-ab79-4083-ba87-ed78bfa79d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:55.018304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:55.019213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.019495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.019771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.021080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:55.022549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:55.024586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 78/159] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:54 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:55.030019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:55.071521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 82/160] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:55.097659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918960c3-ab79-4083-ba87-ed78bfa79d55 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:55.135775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df870fb-0e68-44cb-9702-71a569e3bc7d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:55.171080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:55.171779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.172643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.173664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.206753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918960c3-ab79-4083-ba87-ed78bfa79d55 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:55.244980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:55.246554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.247054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.247182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:55.247667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.248629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:55.249355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:55.251279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:55.253579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 83/161] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:55.259090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:55.355367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 79/162] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:49:55.361556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:55.370062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90f4dd-43aa-4ea1-8012-e909f2fb8e38 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:55.405467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d703d69-1393-4b17-aa68-5ae3df065b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:55.407073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703d69-1393-4b17-aa68-5ae3df065b8b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.407672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703d69-1393-4b17-aa68-5ae3df065b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.408144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d703d69-1393-4b17-aa68-5ae3df065b8b None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.409104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d703d69-1393-4b17-aa68-5ae3df065b8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:55.410768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d703d69-1393-4b17-aa68-5ae3df065b8b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:55.462915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce356fce-aad7-4dff-9fef-eac9661365f7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:55.497773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f660e57-705f-411d-b641-a46efec2c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:55.498632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660e57-705f-411d-b641-a46efec2c1cd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.498912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660e57-705f-411d-b641-a46efec2c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.499218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f660e57-705f-411d-b641-a46efec2c1cd None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.501195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f660e57-705f-411d-b641-a46efec2c1cd None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:55.502638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f660e57-705f-411d-b641-a46efec2c1cd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:55.504559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 80/163] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:55 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:55.508607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e61c4-55fc-4690-aba3-8ec3f2a72eaa None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.509395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e61c4-55fc-4690-aba3-8ec3f2a72eaa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.509922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479e61c4-55fc-4690-aba3-8ec3f2a72eaa None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.511813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 81/164] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:55.512710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e61c4-55fc-4690-aba3-8ec3f2a72eaa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:55.534330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 84/165] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:49:55 2022] POST /identity/v3/users => generated 283 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:49:55.534330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fb28-1dd2-42a7-8032-f2f8c58af12d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.534330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fb28-1dd2-42a7-8032-f2f8c58af12d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.534330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1fb28-1dd2-42a7-8032-f2f8c58af12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.572646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-dab1fb28-1dd2-42a7-8032-f2f8c58af12d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:55.574761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-dab1fb28-1dd2-42a7-8032-f2f8c58af12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:55.665997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479e61c4-55fc-4690-aba3-8ec3f2a72eaa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:55.673928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 85/166] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:55.700000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1fb28-1dd2-42a7-8032-f2f8c58af12d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:55.730587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf436cc-31e3-43ca-8255-427e8ab178f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:55.731961 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf436cc-31e3-43ca-8255-427e8ab178f5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.732596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf436cc-31e3-43ca-8255-427e8ab178f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.733475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf436cc-31e3-43ca-8255-427e8ab178f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.734864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf436cc-31e3-43ca-8255-427e8ab178f5 None admin] RBAC: Adding query filter params (role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=0c09c92ec34a444caeb82c56a979d386) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:55.735572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf436cc-31e3-43ca-8255-427e8ab178f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:55.737881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf436cc-31e3-43ca-8255-427e8ab178f5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:55.813494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 82/167] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:55 2022] GET /identity/v3/role_assignments?user.id=0c09c92ec34a444caeb82c56a979d386&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:55.814571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1fb28-1dd2-42a7-8032-f2f8c58af12d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:55.829095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a864b36-9f55-4c27-8aa0-17846dabfdb4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.829386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a864b36-9f55-4c27-8aa0-17846dabfdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.829698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a864b36-9f55-4c27-8aa0-17846dabfdb4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.831100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 83/168] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:49:55.838423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587330f-7bfb-4dc8-9b87-93494f9718b1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.838832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587330f-7bfb-4dc8-9b87-93494f9718b1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.839250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587330f-7bfb-4dc8-9b87-93494f9718b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.858131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4587330f-7bfb-4dc8-9b87-93494f9718b1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:55.859559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4587330f-7bfb-4dc8-9b87-93494f9718b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:55.860261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:55.861274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:55.861727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:55.862143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:55.873870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:55.882801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:55.884080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:55.884876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 86/169] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:55.890068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:55.959625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 84/170] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:55.986360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587330f-7bfb-4dc8-9b87-93494f9718b1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.049249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63ae01-e7a6-4330-a5d4-ae9f7b858920 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.092629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.093307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.093596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.094000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.094703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:56.095013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.096501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.107379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 87/171] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:56.110995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587330f-7bfb-4dc8-9b87-93494f9718b1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.114217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.150637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.151514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.151798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.152072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.164645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:56.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:56.173702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:56.174955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 85/172] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:56.182654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.222268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a617f0-3478-47bd-885e-2a37fc499d3e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.263426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.264305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.264587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.264857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] PATH_INFO: `/v3/users/0c09c92ec34a444caeb82c56a979d386` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.266989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] RBAC: Authorizing `identity:get_user(user_id=0c09c92ec34a444caeb82c56a979d386)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.269465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.271377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 88/173] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:56 2022] GET /identity/v3/users/0c09c92ec34a444caeb82c56a979d386 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:56.276977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.309254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9673-1a4e-41d4-b07c-dfc7cdeb1991 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.348523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.349580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.350069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.350559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.351555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:56.352087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.353729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.367320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 86/174] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:56.369805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.403005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d61c0-caee-4682-be29-ab4893e9d0d5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.445313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.446220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.446522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.446799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.481921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52e925-703f-4efc-b146-9807642c683e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.517713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.518938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.519450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.520029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] PATH_INFO: `/v3/users/59acd2c41da849ca8a48ca8787ee3f78` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.521460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=59acd2c41da849ca8a48ca8787ee3f78)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.523172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.528756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.529086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 87/175] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:56 2022] GET /identity/v3/users/59acd2c41da849ca8a48ca8787ee3f78 => generated 289 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:56.530474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.532056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.647175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b0069-982a-4b55-b6e2-168c4be17ba2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.690835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.697513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.698034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.698481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.699957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.701591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.712801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 88/176] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:56 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:49:56.713470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.767279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 89/177] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:56.772875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:56.825437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655e2d0-484c-4fb8-a48a-c8f712c8fb94 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.865769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.866682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.866967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.867273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/59acd2c41da849ca8a48ca8787ee3f78/roles/b5d48eb189cd4e0da28af8d6f283bef6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.874730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b5422852e4a658bdd2ef28748da83, user_id=59acd2c41da849ca8a48ca8787ee3f78, role_id=b5d48eb189cd4e0da28af8d6f283bef6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.876850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.940449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088a561-4bb1-41d2-b68c-3bcd76541ef2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:56.955325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 89/178] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:49:56 2022] PUT /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83/users/59acd2c41da849ca8a48ca8787ee3f78/roles/b5d48eb189cd4e0da28af8d6f283bef6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:49:56.981396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c11c167-8937-4486-acfe-3375055974d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:56.982378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c167-8937-4486-acfe-3375055974d2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:56.982645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c167-8937-4486-acfe-3375055974d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:56.982973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c11c167-8937-4486-acfe-3375055974d2 None admin] PATH_INFO: `/v3/projects/348ca40a735c43a78c975c6caed75d66` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:56.984596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c167-8937-4486-acfe-3375055974d2 None admin] RBAC: Authorizing `identity:get_project(project_id=348ca40a735c43a78c975c6caed75d66)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:56.986204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c11c167-8937-4486-acfe-3375055974d2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:56.988353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 90/179] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:56 2022] GET /identity/v3/projects/348ca40a735c43a78c975c6caed75d66 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:56.996260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:57.123158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e669650-5321-4290-917b-b4ee92f60269 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:57.159535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cfb751-9403-4977-9f4d-7482af439bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:57.160202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb751-9403-4977-9f4d-7482af439bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:57.160486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb751-9403-4977-9f4d-7482af439bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:57.160764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cfb751-9403-4977-9f4d-7482af439bd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:57.161621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfb751-9403-4977-9f4d-7482af439bd1 None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=348ca40a735c43a78c975c6caed75d66, user.id=0c09c92ec34a444caeb82c56a979d386) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:57.161934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfb751-9403-4977-9f4d-7482af439bd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:57.163488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cfb751-9403-4977-9f4d-7482af439bd1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:57.170860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 90/180] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:56 2022] GET /identity/v3/role_assignments?user.id=0c09c92ec34a444caeb82c56a979d386&scope.project.id=348ca40a735c43a78c975c6caed75d66&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:58.139045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003d1e2-07c4-4607-87d5-a9530b061542 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.139576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003d1e2-07c4-4607-87d5-a9530b061542 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.139652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003d1e2-07c4-4607-87d5-a9530b061542 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.141938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 91/181] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:58.147236 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b4e6b-178c-4adc-9f79-ffeb57a7bf01 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.147740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b4e6b-178c-4adc-9f79-ffeb57a7bf01 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.147891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b4e6b-178c-4adc-9f79-ffeb57a7bf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.165820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9e9b4e6b-178c-4adc-9f79-ffeb57a7bf01 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:58.167024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9e9b4e6b-178c-4adc-9f79-ffeb57a7bf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:58.236004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 91/182] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:58.259441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003d1e2-07c4-4607-87d5-a9530b061542 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:58.368105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003d1e2-07c4-4607-87d5-a9530b061542 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:58.407812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce93f41-4642-4ef5-b083-3f4b25eae9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:58.408561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce93f41-4642-4ef5-b083-3f4b25eae9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.408840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce93f41-4642-4ef5-b083-3f4b25eae9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.409114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce93f41-4642-4ef5-b083-3f4b25eae9c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.420293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce93f41-4642-4ef5-b083-3f4b25eae9c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-bce93f41-4642-4ef5-b083-3f4b25eae9c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:58.428448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:58.430498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:58.432405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 92/183] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:49:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:49:58.436178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b4e6b-178c-4adc-9f79-ffeb57a7bf01 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:58.539888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b4e6b-178c-4adc-9f79-ffeb57a7bf01 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:58.568789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274787-17ed-4cd7-a31a-af121086a52c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.569084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274787-17ed-4cd7-a31a-af121086a52c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.569359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1274787-17ed-4cd7-a31a-af121086a52c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.570877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 93/184] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:58.577531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ca21-dd9b-4481-9959-73dee6ebcace None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.577844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ca21-dd9b-4481-9959-73dee6ebcace None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.578615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ca21-dd9b-4481-9959-73dee6ebcace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.582893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:58.583957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.584471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.584952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.585943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:58.586470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:58.588116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:58.597954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 92/185] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:58.600174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3585ca21-dd9b-4481-9959-73dee6ebcace None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:58.604780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3585ca21-dd9b-4481-9959-73dee6ebcace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:58.613303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:58.703838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 94/186] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:49:58.719753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ca21-dd9b-4481-9959-73dee6ebcace None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:58.726613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcb99-a9c6-47b1-9826-f9b01a97b309 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:58.767823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c0a62-7c79-4e43-a753-72c7a3e2e775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:58.769076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c0a62-7c79-4e43-a753-72c7a3e2e775 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.769877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c0a62-7c79-4e43-a753-72c7a3e2e775 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.770340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c0a62-7c79-4e43-a753-72c7a3e2e775 None admin] PATH_INFO: `/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.789623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c0a62-7c79-4e43-a753-72c7a3e2e775 None admin] RBAC: Authorizing `identity:get_user(user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:58.791077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c0a62-7c79-4e43-a753-72c7a3e2e775 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:58.792828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 93/187] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:58 2022] GET /identity/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:58.798843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de6cc-fc9a-47af-aa1a-2e19c3f23d05 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.799153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de6cc-fc9a-47af-aa1a-2e19c3f23d05 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.799448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de6cc-fc9a-47af-aa1a-2e19c3f23d05 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.800940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 94/188] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:58.801473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de6cc-fc9a-47af-aa1a-2e19c3f23d05 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:58.832410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ca21-dd9b-4481-9959-73dee6ebcace None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:58.866577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a095b1b-8212-4bd1-8923-e5a573648560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:58.867405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095b1b-8212-4bd1-8923-e5a573648560 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.867682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095b1b-8212-4bd1-8923-e5a573648560 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.867955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a095b1b-8212-4bd1-8923-e5a573648560 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.878023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a095b1b-8212-4bd1-8923-e5a573648560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0a095b1b-8212-4bd1-8923-e5a573648560 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:58.886006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:58.886924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 95/189] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:49:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:58.892349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a49f-9e61-40ce-87f1-c82e5e89c244 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.893236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a49f-9e61-40ce-87f1-c82e5e89c244 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.893236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305a49f-9e61-40ce-87f1-c82e5e89c244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.906030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102de6cc-fc9a-47af-aa1a-2e19c3f23d05 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:58.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9305a49f-9e61-40ce-87f1-c82e5e89c244 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:58.909782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9305a49f-9e61-40ce-87f1-c82e5e89c244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:58.941574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:58.942450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:58.942872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:58.943354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:58.982696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 96/190] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:58.983934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305a49f-9e61-40ce-87f1-c82e5e89c244 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.022927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.024472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.092617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305a49f-9e61-40ce-87f1-c82e5e89c244 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.121967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 95/191] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:59.122780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.134326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.135000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.135313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.135589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.136349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:59.136716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.138154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.151332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 97/192] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:49:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:59.151332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.223814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef462bf-f470-474a-8053-311763631e7e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.244910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6631a14-52b2-4634-8e33-5782c34cc069 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.256194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.257047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.257333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.257606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.258883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.260405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.262253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 96/193] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:59.262822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.279292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.280154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.280437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.280716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.282504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.283988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.285854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 98/194] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:59.286401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.371548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f61fc-e890-412a-bdcb-e18b1a35b824 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.391253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2520889-0496-4d0f-921b-863af61d1f5b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.408280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.409154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.409470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.409695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] PATH_INFO: `/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.410883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] RBAC: Authorizing `identity:get_user(user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.412362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.418731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 97/195] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:59.419409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.424798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.425473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.425762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.426043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.426756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.428325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.507727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 99/196] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:49:59 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:49:59.508847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.528783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645b976-7323-41a3-acdd-4aed7966767e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.571502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aafa53-79c5-472e-b6b6-541d0b9b2381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.572186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aafa53-79c5-472e-b6b6-541d0b9b2381 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.572466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aafa53-79c5-472e-b6b6-541d0b9b2381 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.572742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aafa53-79c5-472e-b6b6-541d0b9b2381 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.573600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aafa53-79c5-472e-b6b6-541d0b9b2381 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:49:59.573916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aafa53-79c5-472e-b6b6-541d0b9b2381 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.575424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aafa53-79c5-472e-b6b6-541d0b9b2381 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.582378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 98/197] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/role_assignments?user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:49:59.582378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d7fc-6cf2-401d-ab64-b3a2b1906740 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.582378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d7fc-6cf2-401d-ab64-b3a2b1906740 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.582378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc1d7fc-6cf2-401d-ab64-b3a2b1906740 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.582378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 99/198] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:49:59.591457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3a3b-4e63-4b02-ad4d-55d845610538 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.591818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3a3b-4e63-4b02-ad4d-55d845610538 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.592162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e3a3b-4e63-4b02-ad4d-55d845610538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.611735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b78e3a3b-4e63-4b02-ad4d-55d845610538 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:49:59.613137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b78e3a3b-4e63-4b02-ad4d-55d845610538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:49:59.646857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd80059-6018-41a4-abd5-0338a609c2fe None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.690588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.691668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.692186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.692870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.705010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 100/199] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:49:59.728783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e3a3b-4e63-4b02-ad4d-55d845610538 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.800956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:49:59.801509 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:49:59.873980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e3a3b-4e63-4b02-ad4d-55d845610538 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:49:59.914743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:49:59.915591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:49:59.915870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:49:59.916601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:49:59.930597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 100/200] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:49:59.931812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:49:59.935557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:49:59.939898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:49:59.940791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:49:59.941989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 101/201] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:49:59.946818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:00.036378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82219476-840a-40dd-8e5a-b1e04583ccb1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:00.054252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559229-57d8-4e45-a8c8-39636a444ea4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:00.072099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:00.072960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:00.073239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:00.073516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:00.074723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:00.076231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:00.078644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 101/202] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:00.085028 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:00.090426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:00.091158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:00.091461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:00.091744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:00.092519 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:00.092831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:00.095067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:00.104286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 102/203] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:49:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:00.109512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:00.198269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ea231-a172-4f62-b840-d4fe2def99a4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:00.224757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695a084-75a2-48de-a53b-3dc41f7085f6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:00.233345 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:00.234005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:00.234346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:00.235220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:00.236163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] RBAC: Adding query filter params (role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:00.236475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:00.237939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:00.243781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 102/204] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:00 2022] GET /identity/v3/role_assignments?user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:00.264051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:00.264955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:00.265242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:00.265578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] PATH_INFO: `/v3/users/59acd2c41da849ca8a48ca8787ee3f78` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:00.267398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] RBAC: Authorizing `identity:get_user(user_id=59acd2c41da849ca8a48ca8787ee3f78)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:00.269204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:00.271173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 103/205] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:00 2022] GET /identity/v3/users/59acd2c41da849ca8a48ca8787ee3f78 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:00.276521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:00.382856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5bd37-9174-4f96-bf1d-8a0e3d5df28e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:00.419060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:00.420007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:00.420296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:00.420573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:00.493515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:00.495002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:00.602690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:00.608112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:00.749866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fb886-27b0-4fe6-9212-67dab3a24f97 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:00.749866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7efb86-997a-477d-8e5a-6c9bd3bc63df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:00.749866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7efb86-997a-477d-8e5a-6c9bd3bc63df None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:00.749866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7efb86-997a-477d-8e5a-6c9bd3bc63df None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:00.750751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7efb86-997a-477d-8e5a-6c9bd3bc63df None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:00.750751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7efb86-997a-477d-8e5a-6c9bd3bc63df None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:00.750751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7efb86-997a-477d-8e5a-6c9bd3bc63df None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:00.752066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 104/207] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:00 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:00.757703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:00.867704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77d273-c1e2-484d-a1e7-0c08b1f6ffc0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:00.904160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742d5ba-0fe3-476d-a443-8d72676a39d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:00.904818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d5ba-0fe3-476d-a443-8d72676a39d1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:00.905105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d5ba-0fe3-476d-a443-8d72676a39d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:00.905385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742d5ba-0fe3-476d-a443-8d72676a39d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:00.906257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742d5ba-0fe3-476d-a443-8d72676a39d1 None admin] RBAC: Adding query filter params (role.id=b5d48eb189cd4e0da28af8d6f283bef6, scope.project.id=0e4b5422852e4a658bdd2ef28748da83, user.id=59acd2c41da849ca8a48ca8787ee3f78) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:00.906574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742d5ba-0fe3-476d-a443-8d72676a39d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:00.908050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742d5ba-0fe3-476d-a443-8d72676a39d1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:00.914140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 104/208] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:00 2022] GET /identity/v3/role_assignments?user.id=59acd2c41da849ca8a48ca8787ee3f78&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=b5d48eb189cd4e0da28af8d6f283bef6 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:02.100211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b0fe7-5c7f-49f9-8c24-7701bebb6eac None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.100714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b0fe7-5c7f-49f9-8c24-7701bebb6eac None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.100789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b0fe7-5c7f-49f9-8c24-7701bebb6eac None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.102252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 105/209] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:02.108301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1557d5a-bef6-44e0-92a1-f653d9c137f5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.108301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1557d5a-bef6-44e0-92a1-f653d9c137f5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.108301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1557d5a-bef6-44e0-92a1-f653d9c137f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.126647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c1557d5a-bef6-44e0-92a1-f653d9c137f5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:02.128184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c1557d5a-bef6-44e0-92a1-f653d9c137f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:02.199518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:02.211276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf75560-c1af-43bd-ba54-61098ed35f71 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.211566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf75560-c1af-43bd-ba54-61098ed35f71 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.211847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf75560-c1af-43bd-ba54-61098ed35f71 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.213498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 106/211] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:02.219006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639f27-3cb7-48e3-8a7e-519d607bd25e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.219451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639f27-3cb7-48e3-8a7e-519d607bd25e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.219731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4639f27-3cb7-48e3-8a7e-519d607bd25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.221337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf75560-c1af-43bd-ba54-61098ed35f71 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.238375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d4639f27-3cb7-48e3-8a7e-519d607bd25e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:02.239580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d4639f27-3cb7-48e3-8a7e-519d607bd25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:02.307085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 106/212] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:02.331259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639f27-3cb7-48e3-8a7e-519d607bd25e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.345788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf75560-c1af-43bd-ba54-61098ed35f71 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:02.384906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:02.386042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.386558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.387039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.398200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:02.406683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:02.407774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:02.408580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:02.410975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 107/213] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:02.421035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.438475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4639f27-3cb7-48e3-8a7e-519d607bd25e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:02.473439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:02.474289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.474573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.474845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.485606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:02.493912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:02.494819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:02.495675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 107/214] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:02.500860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.527735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77caa4-4370-4c7a-81ad-c2cba573d5b3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:02.564912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0147bb0-904a-4399-88f9-38727404cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:02.566449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0147bb0-904a-4399-88f9-38727404cfcc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.566920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0147bb0-904a-4399-88f9-38727404cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.567401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0147bb0-904a-4399-88f9-38727404cfcc None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.568332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0147bb0-904a-4399-88f9-38727404cfcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:02.568941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0147bb0-904a-4399-88f9-38727404cfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:02.573465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0147bb0-904a-4399-88f9-38727404cfcc None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:02.583507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 108/215] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:02.585604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117d920-7bb4-4bdf-a74c-7db6e8051990 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.586158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117d920-7bb4-4bdf-a74c-7db6e8051990 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.586596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117d920-7bb4-4bdf-a74c-7db6e8051990 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.588456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 109/216] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:02.589340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117d920-7bb4-4bdf-a74c-7db6e8051990 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.607816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9644020-08fc-4e88-bdb0-47762cf3581b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:02.641046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753177f-8119-405e-be8b-90238c42ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:02.641744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753177f-8119-405e-be8b-90238c42ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.642024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753177f-8119-405e-be8b-90238c42ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.642302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753177f-8119-405e-be8b-90238c42ecf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.643048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753177f-8119-405e-be8b-90238c42ecf9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:02.643384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753177f-8119-405e-be8b-90238c42ecf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:02.644814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753177f-8119-405e-be8b-90238c42ecf9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:02.653468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 108/217] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:02.660287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39090-1a9e-420a-bd6e-e024ff575a27 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.660618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39090-1a9e-420a-bd6e-e024ff575a27 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.660855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf39090-1a9e-420a-bd6e-e024ff575a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.676939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bbf39090-1a9e-420a-bd6e-e024ff575a27 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:02.678109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bbf39090-1a9e-420a-bd6e-e024ff575a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:02.694677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117d920-7bb4-4bdf-a74c-7db6e8051990 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:02.728621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:02.729528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.729813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.730090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] PATH_INFO: `/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.731455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] RBAC: Authorizing `identity:get_user(user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:02.732954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:02.735363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 110/218] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:02.736197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.761995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 109/219] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:02.763319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39090-1a9e-420a-bd6e-e024ff575a27 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.850928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a918e-c673-416a-9266-ae9162eb221c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:02.862719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf39090-1a9e-420a-bd6e-e024ff575a27 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:02.883653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:02.884524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.884800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.885075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] PATH_INFO: `/v3/users/77e4229e165d41f1af2b3b1931d22e6c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.896380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:02.897175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:02.897458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:02.897736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:02.898911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:02.899077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] RBAC: Authorizing `identity:get_user(user_id=77e4229e165d41f1af2b3b1931d22e6c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:02.900406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:02.900520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:02.902634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 110/220] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:02.902738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 111/221] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/users/77e4229e165d41f1af2b3b1931d22e6c => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:02.902937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.912137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:02.998375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54187d3e-513b-4d54-bb3e-1f003e8c7722 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.005610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e7052-fc2f-4336-9954-a7a02d62c463 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.030691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.031594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.031871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.032146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.033320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:03.034769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:03.036607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 111/222] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:03.037192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:03.040352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b5e7c-e3e6-4a17-b0fc-0450e2b48ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.041004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5e7c-e3e6-4a17-b0fc-0450e2b48ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.041281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5e7c-e3e6-4a17-b0fc-0450e2b48ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.041552 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b5e7c-e3e6-4a17-b0fc-0450e2b48ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.105123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b5e7c-e3e6-4a17-b0fc-0450e2b48ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:03.106560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b5e7c-e3e6-4a17-b0fc-0450e2b48ef9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:03.132880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c54dce-f53f-4baa-8b96-3add2e6af426 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.166326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.167154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.167435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.167710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/4c62cee5b7ad4e479cc82e0e2dd21d6a/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.169905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe6e0792f3432ab55581cdd4965083, user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:03.171370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:03.199965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 112/223] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:03.201272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db820a73-c2f8-4105-be72-6af76a9408ba None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.201559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db820a73-c2f8-4105-be72-6af76a9408ba None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.201835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db820a73-c2f8-4105-be72-6af76a9408ba None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.203147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 113/224] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:03.203825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db820a73-c2f8-4105-be72-6af76a9408ba None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:03.278326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 112/225] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:03 2022] PUT /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/4c62cee5b7ad4e479cc82e0e2dd21d6a/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:03.279216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:03.304357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db820a73-c2f8-4105-be72-6af76a9408ba None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.345569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.346268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.346553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.346828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.347614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:03.349101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:03.387708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43db24-7534-44be-97b5-493f40601843 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.424811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34285b8f-0388-46a6-91d7-5106b81bd745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.425593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34285b8f-0388-46a6-91d7-5106b81bd745 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.425872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34285b8f-0388-46a6-91d7-5106b81bd745 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.426145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34285b8f-0388-46a6-91d7-5106b81bd745 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.427547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34285b8f-0388-46a6-91d7-5106b81bd745 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:03.429030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34285b8f-0388-46a6-91d7-5106b81bd745 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:03.430790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 113/226] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:03 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:03.433343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 114/227] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:03 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:03.437215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac20b-be9a-4211-b7bf-ef9d919e09da None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.437605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac20b-be9a-4211-b7bf-ef9d919e09da None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.443216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ac20b-be9a-4211-b7bf-ef9d919e09da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.443371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:03.468199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-170ac20b-be9a-4211-b7bf-ef9d919e09da None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:03.470432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-170ac20b-be9a-4211-b7bf-ef9d919e09da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:03.547837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 114/228] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:03.565565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584028fa-a853-4b6a-838f-29eb062db055 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.570163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac20b-be9a-4211-b7bf-ef9d919e09da None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:03.608228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.609893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.610411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.610887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.611992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=77e4229e165d41f1af2b3b1931d22e6c) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:03.612540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:03.614228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:03.621794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 115/229] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:03 2022] GET /identity/v3/role_assignments?user.id=77e4229e165d41f1af2b3b1931d22e6c&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:03.691925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ac20b-be9a-4211-b7bf-ef9d919e09da None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.731485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.732320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.732600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.732875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.745632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:03.754797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:03.755804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:03.756613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 115/230] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:03.763545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:03.876564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d5028-e6bc-483c-a46b-4e2d3a3e341b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:03.910741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:03.911529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:03.911812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:03.912138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:03.912900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:03.913209 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:03.914654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:03.925450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 116/231] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:03.931153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:04.034452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d7c8c-b708-44ec-b657-be68a88cfedc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:04.070064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:04.070987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:04.071311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:04.071586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] PATH_INFO: `/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:04.072788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] RBAC: Authorizing `identity:get_user(user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:04.074236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:04.075877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 116/232] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:03 2022] GET /identity/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:04.082318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:04.186955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61748a-64ca-494e-8962-bf1ef686c218 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:04.221363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfc2f9-68a4-41b9-bec2-f446e27cb208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:04.222228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc2f9-68a4-41b9-bec2-f446e27cb208 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:04.222510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc2f9-68a4-41b9-bec2-f446e27cb208 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:04.222787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfc2f9-68a4-41b9-bec2-f446e27cb208 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:04.224006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc2f9-68a4-41b9-bec2-f446e27cb208 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:04.225466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfc2f9-68a4-41b9-bec2-f446e27cb208 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:04.227477 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 117/233] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:04 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:04.233080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:04.337652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3160f2c-2ce3-4874-99b0-bab28843329a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:04.370760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ae64e-04ce-4148-829a-e14e0f6220a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:04.371682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae64e-04ce-4148-829a-e14e0f6220a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:04.371959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae64e-04ce-4148-829a-e14e0f6220a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:04.372229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ae64e-04ce-4148-829a-e14e0f6220a7 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/4c62cee5b7ad4e479cc82e0e2dd21d6a/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:04.374470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae64e-04ce-4148-829a-e14e0f6220a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe6e0792f3432ab55581cdd4965083, user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a, role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:04.376271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ae64e-04ce-4148-829a-e14e0f6220a7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:04.461680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 117/234] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:04 2022] PUT /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/4c62cee5b7ad4e479cc82e0e2dd21d6a/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:06.081090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062601c2-97d3-4bae-a1f5-bf70937f3669 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.081587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062601c2-97d3-4bae-a1f5-bf70937f3669 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.081587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062601c2-97d3-4bae-a1f5-bf70937f3669 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.083274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 118/235] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:06.089007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e56174-5361-42a7-b97d-0da02b4d29b0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.089504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e56174-5361-42a7-b97d-0da02b4d29b0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.089608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e56174-5361-42a7-b97d-0da02b4d29b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.111920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-62e56174-5361-42a7-b97d-0da02b4d29b0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:06.113164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62e56174-5361-42a7-b97d-0da02b4d29b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:06.188641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 118/236] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:06.211608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062601c2-97d3-4bae-a1f5-bf70937f3669 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:06.301651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc576b6-c2bb-4dab-9355-7a852bb11569 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.301983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc576b6-c2bb-4dab-9355-7a852bb11569 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.302210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc576b6-c2bb-4dab-9355-7a852bb11569 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.303977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 119/237] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:06.313150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d887ef-e514-4378-a71a-1221abf42b18 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.313602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d887ef-e514-4378-a71a-1221abf42b18 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.314020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d887ef-e514-4378-a71a-1221abf42b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.329092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062601c2-97d3-4bae-a1f5-bf70937f3669 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:06.332642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-12d887ef-e514-4378-a71a-1221abf42b18 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:06.333168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-12d887ef-e514-4378-a71a-1221abf42b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:06.388482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:06.389563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.389993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.390526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.405454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 120/238] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:06.417293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:06.428919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d887ef-e514-4378-a71a-1221abf42b18 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:06.433997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:06.435082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:06.436099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:06.438600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 119/239] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:06.446315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:06.537039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d887ef-e514-4378-a71a-1221abf42b18 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:06.572529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:06.573512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.573923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.574442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.580664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25540bf-7995-4745-9047-34d7b5e2811b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:06.585557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:06.593263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:06.595003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:06.595839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 121/240] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:06.601179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:06.636434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142383b6-3d75-4455-a5b3-7336cff12e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:06.637124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142383b6-3d75-4455-a5b3-7336cff12e1b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.637411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142383b6-3d75-4455-a5b3-7336cff12e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.637687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142383b6-3d75-4455-a5b3-7336cff12e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.638457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142383b6-3d75-4455-a5b3-7336cff12e1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:06.638765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142383b6-3d75-4455-a5b3-7336cff12e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:06.640288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142383b6-3d75-4455-a5b3-7336cff12e1b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:06.650013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 120/241] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:06.651619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900464e-1406-456d-9046-e1a9fe12d64d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.652125 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900464e-1406-456d-9046-e1a9fe12d64d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.652625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900464e-1406-456d-9046-e1a9fe12d64d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.658785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 121/242] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:06.659890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900464e-1406-456d-9046-e1a9fe12d64d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:06.707672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407402e-4f93-4726-b3bc-6ab38be1048b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:06.740387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e33ba-3ba9-4a07-874f-0b3be5b77516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:06.741099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e33ba-3ba9-4a07-874f-0b3be5b77516 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.741379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e33ba-3ba9-4a07-874f-0b3be5b77516 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.741681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e33ba-3ba9-4a07-874f-0b3be5b77516 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.742429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e33ba-3ba9-4a07-874f-0b3be5b77516 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:06.742733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e33ba-3ba9-4a07-874f-0b3be5b77516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:06.744223 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e33ba-3ba9-4a07-874f-0b3be5b77516 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:06.753661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 122/243] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:06.755219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce8bc9-b5d9-4f34-a83a-378992adc763 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.755716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce8bc9-b5d9-4f34-a83a-378992adc763 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.756199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce8bc9-b5d9-4f34-a83a-378992adc763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.762184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900464e-1406-456d-9046-e1a9fe12d64d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:06.774005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e6ce8bc9-b5d9-4f34-a83a-378992adc763 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:06.775649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e6ce8bc9-b5d9-4f34-a83a-378992adc763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:06.797532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2239c8b-fbf0-4c6c-8c68-b3be499c5e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:06.798570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239c8b-fbf0-4c6c-8c68-b3be499c5e95 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.798896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239c8b-fbf0-4c6c-8c68-b3be499c5e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.799147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2239c8b-fbf0-4c6c-8c68-b3be499c5e95 None admin] PATH_INFO: `/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.800350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2239c8b-fbf0-4c6c-8c68-b3be499c5e95 None admin] RBAC: Authorizing `identity:get_user(user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:06.801791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2239c8b-fbf0-4c6c-8c68-b3be499c5e95 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:06.803693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 122/244] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:06 2022] GET /identity/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:06.808815 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638b738-d34e-4f29-9c2c-e36663cb792d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:06.809101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638b738-d34e-4f29-9c2c-e36663cb792d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:06.809377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638b738-d34e-4f29-9c2c-e36663cb792d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:06.810760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 123/245] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:06.816034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638b738-d34e-4f29-9c2c-e36663cb792d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:06.932419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 123/246] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:06.940131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce8bc9-b5d9-4f34-a83a-378992adc763 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.004295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638b738-d34e-4f29-9c2c-e36663cb792d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.039082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48335c-b517-49d7-bce9-1ce69d5df1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.039988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48335c-b517-49d7-bce9-1ce69d5df1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.040091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce8bc9-b5d9-4f34-a83a-378992adc763 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.040270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48335c-b517-49d7-bce9-1ce69d5df1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.040526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48335c-b517-49d7-bce9-1ce69d5df1c8 None admin] PATH_INFO: `/v3/users/77e4229e165d41f1af2b3b1931d22e6c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.041708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48335c-b517-49d7-bce9-1ce69d5df1c8 None admin] RBAC: Authorizing `identity:get_user(user_id=77e4229e165d41f1af2b3b1931d22e6c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.043331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48335c-b517-49d7-bce9-1ce69d5df1c8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.049765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 124/247] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:06 2022] GET /identity/v3/users/77e4229e165d41f1af2b3b1931d22e6c => generated 297 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:07.049765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923951-0b4e-4523-abb3-78a6db288816 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.049765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923951-0b4e-4523-abb3-78a6db288816 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.049765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3923951-0b4e-4523-abb3-78a6db288816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.065392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f3923951-0b4e-4523-abb3-78a6db288816 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:07.066579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f3923951-0b4e-4523-abb3-78a6db288816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:07.078373 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.078705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.078957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.079265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.134176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 125/248] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:07.135678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3923951-0b4e-4523-abb3-78a6db288816 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.159745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.161262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.236266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3923951-0b4e-4523-abb3-78a6db288816 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.259646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 124/249] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:07.260800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.270464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.271432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.271713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.271987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.273165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.274608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.281039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 126/250] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:07.282380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.363613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1717e6-89ce-44ee-bd54-e62492262fc1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.377574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa41d59-eb05-41c6-af49-a55f516eccc9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.395944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.396799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.397079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.397351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.398566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.400060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.401946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 125/251] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:07.402501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.412252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.413127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.413483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.413827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.425743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:07.433819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:07.434898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 127/252] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:07.435839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.497949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d028470-d2cd-451d-9b79-9a2e9488abab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.528787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610a97b-f704-4157-b3b2-9f46758f50ae None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.529852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dcb56-0732-471a-85b5-6e0aa2c9661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.530696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dcb56-0732-471a-85b5-6e0aa2c9661e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.530979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dcb56-0732-471a-85b5-6e0aa2c9661e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.531432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dcb56-0732-471a-85b5-6e0aa2c9661e None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.532668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dcb56-0732-471a-85b5-6e0aa2c9661e None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.534122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dcb56-0732-471a-85b5-6e0aa2c9661e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.535826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 126/253] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:07.540245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3121f-900f-49ed-8d8f-a3a0752200f9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.540746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3121f-900f-49ed-8d8f-a3a0752200f9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.540860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3121f-900f-49ed-8d8f-a3a0752200f9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.542049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 127/254] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:07.542728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3121f-900f-49ed-8d8f-a3a0752200f9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.564239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.564908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.565193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.565464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.566170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.567626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.639915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3121f-900f-49ed-8d8f-a3a0752200f9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.672849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.673545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 128/255] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:07 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:07.673769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.674020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.674373 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/77e4229e165d41f1af2b3b1931d22e6c/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.674489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.676521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe6e0792f3432ab55581cdd4965083, user_id=77e4229e165d41f1af2b3b1931d22e6c, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.678072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.753281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 128/256] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:07 2022] PUT /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/77e4229e165d41f1af2b3b1931d22e6c/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:07.754545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.781971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26464411-130a-4a9b-8b23-d2ad0ebf3a78 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.820552 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd73cf8-9494-44fd-8c06-d405bcba5936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.821346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd73cf8-9494-44fd-8c06-d405bcba5936 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.821621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd73cf8-9494-44fd-8c06-d405bcba5936 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.821903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd73cf8-9494-44fd-8c06-d405bcba5936 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.822709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd73cf8-9494-44fd-8c06-d405bcba5936 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:07.823019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd73cf8-9494-44fd-8c06-d405bcba5936 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.824511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd73cf8-9494-44fd-8c06-d405bcba5936 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.835037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 129/257] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:07.836510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68415f-8b3a-4a91-b2ad-6ab9c606c188 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.836851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68415f-8b3a-4a91-b2ad-6ab9c606c188 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.837396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68415f-8b3a-4a91-b2ad-6ab9c606c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.856398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-eb68415f-8b3a-4a91-b2ad-6ab9c606c188 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:07.857771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-eb68415f-8b3a-4a91-b2ad-6ab9c606c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:07.909463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a5395-18a9-4bc9-b6aa-67a97b9d74b8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:07.932941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 130/258] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:07.933827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68415f-8b3a-4a91-b2ad-6ab9c606c188 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:07.951658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:07.952706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:07.953904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:07.954469 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:07.955553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:07.956074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:07.957829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:07.965262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 129/259] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/role_assignments?user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:07.966382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:08.042114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68415f-8b3a-4a91-b2ad-6ab9c606c188 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.081001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.081892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.082172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.082446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] PATH_INFO: `/v3/users/9513be64c49c409eb620091766ee8968` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.096897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] RBAC: Authorizing `identity:get_user(user_id=9513be64c49c409eb620091766ee8968)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:08.098621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:08.100551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 131/260] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/users/9513be64c49c409eb620091766ee8968 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:08.108732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:08.111427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523831a-3867-4324-a7ec-d674f9f78541 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.150187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.151404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.151918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.152388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.165579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:08.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:08.177307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:08.178161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:08.180768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 130/261] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:08.187006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:08.222265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb64e74-338e-4f77-8251-10d341689400 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.258843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.259605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.259893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.260174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.302645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba05cdc-2663-4ca0-8b6f-3c8a2b0c420b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.331230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:08.332714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:08.339982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.340995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.341478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.342022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.343017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:08.343613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:08.345801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:08.355113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 131/262] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:08.361144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:08.455973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 132/263] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:08.466135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:08.480496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30727066-5cdc-45e3-a1f3-22609fe10c96 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.517821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.519098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.519607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.520133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] PATH_INFO: `/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.521715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] RBAC: Authorizing `identity:get_user(user_id=4c62cee5b7ad4e479cc82e0e2dd21d6a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:08.523485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:08.525689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 132/264] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:08 2022] GET /identity/v3/users/4c62cee5b7ad4e479cc82e0e2dd21d6a => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:08.532686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:08.570017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c0947-d40e-4617-a23e-c7d07165cc3a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.608369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.609974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.609974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.610270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.611686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:08.613267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:08.615456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 133/265] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:08 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:08.628170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:08.670363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a40c494-e550-4dd0-90b8-79fe050c4819 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.706676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.710721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.710721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.710721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.760848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d278557-30a9-4aaa-95d2-13b75ed6f66f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:08.803536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:08.805025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:08.808828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:08.809563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:08.809848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:08.810124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:08.810978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] RBAC: Adding query filter params (role.id=b5d48eb189cd4e0da28af8d6f283bef6, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=9513be64c49c409eb620091766ee8968) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:08.811316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:08.813542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:08.825373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 134/266] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:08 2022] GET /identity/v3/role_assignments?user.id=9513be64c49c409eb620091766ee8968&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=b5d48eb189cd4e0da28af8d6f283bef6 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:08.965812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 133/267] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:08.972048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:09.113344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef7c18-c7c5-4543-85ee-227995994237 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:09.148715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73bf4c-2022-4130-bb55-8340523863e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:09.149947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73bf4c-2022-4130-bb55-8340523863e9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:09.150453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73bf4c-2022-4130-bb55-8340523863e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:09.150925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73bf4c-2022-4130-bb55-8340523863e9 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:09.152360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73bf4c-2022-4130-bb55-8340523863e9 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:09.154026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73bf4c-2022-4130-bb55-8340523863e9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:09.157009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 135/268] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:08 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:09.163011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:09.270882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c948d4-4588-4cd9-a31b-6098dcdac75e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:09.307579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217091a-f640-46e0-bce4-3db29881c821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:09.308579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217091a-f640-46e0-bce4-3db29881c821 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:09.309064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217091a-f640-46e0-bce4-3db29881c821 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:09.309579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217091a-f640-46e0-bce4-3db29881c821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:09.310609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217091a-f640-46e0-bce4-3db29881c821 None admin] RBAC: Adding query filter params (role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:09.311138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217091a-f640-46e0-bce4-3db29881c821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:09.313905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217091a-f640-46e0-bce4-3db29881c821 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:09.325149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 134/269] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:09 2022] GET /identity/v3/role_assignments?user.id=4c62cee5b7ad4e479cc82e0e2dd21d6a&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:10.395570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03280-3bd8-491e-b760-04273e9158db None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.396712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03280-3bd8-491e-b760-04273e9158db None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.397195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d03280-3bd8-491e-b760-04273e9158db None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.398754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 136/270] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:10.404187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc1e0-ce3c-4072-8ee6-251c8715f4f3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.404579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc1e0-ce3c-4072-8ee6-251c8715f4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.404759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566fc1e0-ce3c-4072-8ee6-251c8715f4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.422962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-566fc1e0-ce3c-4072-8ee6-251c8715f4f3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:10.424168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-566fc1e0-ce3c-4072-8ee6-251c8715f4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:10.499280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 135/271] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:10.518354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03280-3bd8-491e-b760-04273e9158db None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:10.622520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d03280-3bd8-491e-b760-04273e9158db None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:10.664069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:10.664795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.665075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.665349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.676874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:10.680263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30dad-d2f6-449c-adb1-88d759ed8069 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.680559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30dad-d2f6-449c-adb1-88d759ed8069 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.680837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30dad-d2f6-449c-adb1-88d759ed8069 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.682457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 136/272] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:10.684867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:10.685755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:10.686635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 137/273] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:10.689459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50805e-a29e-448f-b63b-e469a1191a6b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.689701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50805e-a29e-448f-b63b-e469a1191a6b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.690077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50805e-a29e-448f-b63b-e469a1191a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.692398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:10.708440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8f50805e-a29e-448f-b63b-e469a1191a6b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:10.709753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f50805e-a29e-448f-b63b-e469a1191a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:10.806981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 137/274] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:10.810366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9faee8e-40f9-459d-9f70-320571f22759 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:10.827143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c844-2ac2-4574-aa3f-93dfb019b98d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.827143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c844-2ac2-4574-aa3f-93dfb019b98d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.827143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f60c844-2ac2-4574-aa3f-93dfb019b98d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.827143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 138/275] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:50:10.832973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387c522-8d12-4c6a-b303-eb2a29c67de3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.833343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387c522-8d12-4c6a-b303-eb2a29c67de3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.833629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387c522-8d12-4c6a-b303-eb2a29c67de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.846013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:10.846695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.846977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.847285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.848039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:10.848345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:10.849727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:10.851029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4387c522-8d12-4c6a-b303-eb2a29c67de3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:10.852256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4387c522-8d12-4c6a-b303-eb2a29c67de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:10.858787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 138/276] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:10.860329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:10.923691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 139/277] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:10.932079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387c522-8d12-4c6a-b303-eb2a29c67de3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:10.961938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3431aa39-6e87-491e-9816-537c5292eae3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:10.995430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:10.996415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:10.996702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:10.996980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:10.998185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:10.999797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.001639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 139/278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:11.002261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.035024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387c522-8d12-4c6a-b303-eb2a29c67de3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.070223 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.071207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.071516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.071760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] PATH_INFO: `/v3/users/77e4229e165d41f1af2b3b1931d22e6c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.072939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] RBAC: Authorizing `identity:get_user(user_id=77e4229e165d41f1af2b3b1931d22e6c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:11.074386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.076199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 140/279] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:10 2022] GET /identity/v3/users/77e4229e165d41f1af2b3b1931d22e6c => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:11.079786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.099993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaae83-7d32-4bad-b101-a801459f7c15 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.132610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.133402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.133682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.133963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.144562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:11.152161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:11.153070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:11.153876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 140/280] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:11.154580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.183191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec32ad-34f7-47ad-8324-93421150f9c2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.221432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.222117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.222400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.222673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.223443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:11.224930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.260986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabc2e8-b0fe-43b1-afd0-ec6e05a082b3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.290103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 141/281] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:11 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:11.294300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5743a2-a601-487d-b5fa-20d39993d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.295249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5743a2-a601-487d-b5fa-20d39993d21d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.295537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5743a2-a601-487d-b5fa-20d39993d21d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.295812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5743a2-a601-487d-b5fa-20d39993d21d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.300688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.370538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5743a2-a601-487d-b5fa-20d39993d21d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:11.372255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5743a2-a601-487d-b5fa-20d39993d21d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.414452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe6a74-8a66-46cc-99c9-85e763202eb3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.450077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683df0c-81a5-40e4-944b-c5c9afceaceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.450669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683df0c-81a5-40e4-944b-c5c9afceaceb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.450951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683df0c-81a5-40e4-944b-c5c9afceaceb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.451259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683df0c-81a5-40e4-944b-c5c9afceaceb None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.452028 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683df0c-81a5-40e4-944b-c5c9afceaceb None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:11.452338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683df0c-81a5-40e4-944b-c5c9afceaceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:11.454353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683df0c-81a5-40e4-944b-c5c9afceaceb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.463516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 142/282] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:11.463516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf57aa-5cb3-4a50-b53b-374c0333de92 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.463516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf57aa-5cb3-4a50-b53b-374c0333de92 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.463516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf57aa-5cb3-4a50-b53b-374c0333de92 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.471450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 143/283] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:11.472210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf57aa-5cb3-4a50-b53b-374c0333de92 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.479887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 141/284] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:11.480946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c7102-df55-4353-a2d5-5a60a23ccdcd None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.481237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c7102-df55-4353-a2d5-5a60a23ccdcd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.481522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c7102-df55-4353-a2d5-5a60a23ccdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.499356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-833c7102-df55-4353-a2d5-5a60a23ccdcd None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:11.501135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-833c7102-df55-4353-a2d5-5a60a23ccdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:11.572108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 142/285] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:11.573130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c7102-df55-4353-a2d5-5a60a23ccdcd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.580121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf57aa-5cb3-4a50-b53b-374c0333de92 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.627864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.628759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.629034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.629307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] PATH_INFO: `/v3/users/20405b526a9d47f59ad0ab634b5270ea` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.644642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] RBAC: Authorizing `identity:get_user(user_id=20405b526a9d47f59ad0ab634b5270ea)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:11.646063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.648002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 144/286] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/users/20405b526a9d47f59ad0ab634b5270ea => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:11.648634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.687628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c7102-df55-4353-a2d5-5a60a23ccdcd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.726751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.726751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.726751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.726751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.727141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:11.727141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.729193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 143/287] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:11.730040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.755650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cadfa0-90c4-4ba4-b7c8-06000a2643b6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.825324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.826299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.826699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.827051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.838680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:11.846697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:11.847608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:11.848426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 145/288] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:11.849094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.856829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afe916-0cf1-4656-9dc5-83033a12e179 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:11.891778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:11.892443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:11.892722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:11.892994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:11.893830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, user.id=20405b526a9d47f59ad0ab634b5270ea, scope.system=all) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:11.894136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:11.895648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:11.901152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 144/289] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/role_assignments?user.id=20405b526a9d47f59ad0ab634b5270ea&scope.system=all&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:11.902014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:11.963534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c72f8c-7b58-421e-9e19-3f5601309fed None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:12.001672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:12.002532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:12.002886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:12.003581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:12.004726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=77e4229e165d41f1af2b3b1931d22e6c) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:12.005048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:12.005944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bbe99-74df-4f4b-87e8-f972bd1666ec None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:12.006822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:12.014807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 146/290] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/role_assignments?user.id=77e4229e165d41f1af2b3b1931d22e6c&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:12.049446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:12.050141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:12.050422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:12.050695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:12.051512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:12.051817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:12.053246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:12.062889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 145/291] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:12.068771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:12.194333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310ee5a-6a57-4443-ab71-3e38a3bfba1e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:12.239964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:12.240915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:12.241200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:12.241521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] PATH_INFO: `/v3/users/9513be64c49c409eb620091766ee8968` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:12.243054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] RBAC: Authorizing `identity:get_user(user_id=9513be64c49c409eb620091766ee8968)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:12.244557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:12.246210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 147/292] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:12 2022] GET /identity/v3/users/9513be64c49c409eb620091766ee8968 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:12.252354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:12.358997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e44a8-75f7-425e-bff5-68800356e412 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:12.392936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aed985-e76e-454b-9c4c-547ce31be22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:12.393791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed985-e76e-454b-9c4c-547ce31be22a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:12.394065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed985-e76e-454b-9c4c-547ce31be22a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:12.394334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed985-e76e-454b-9c4c-547ce31be22a None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:12.395567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aed985-e76e-454b-9c4c-547ce31be22a None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:12.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aed985-e76e-454b-9c4c-547ce31be22a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:12.399059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 146/293] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:12 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:12.404800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:12.508783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061c11f-3472-4de3-8ce5-857b362cc659 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:12.543518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3265d-ed40-4d8d-a387-f598174326e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:12.544409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3265d-ed40-4d8d-a387-f598174326e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:12.544936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3265d-ed40-4d8d-a387-f598174326e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:12.545206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3265d-ed40-4d8d-a387-f598174326e1 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/9513be64c49c409eb620091766ee8968/roles/b5d48eb189cd4e0da28af8d6f283bef6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:12.547745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3265d-ed40-4d8d-a387-f598174326e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe6e0792f3432ab55581cdd4965083, user_id=9513be64c49c409eb620091766ee8968, role_id=b5d48eb189cd4e0da28af8d6f283bef6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:12.549197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3265d-ed40-4d8d-a387-f598174326e1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:12.646128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 148/294] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:12 2022] PUT /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083/users/9513be64c49c409eb620091766ee8968/roles/b5d48eb189cd4e0da28af8d6f283bef6 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:13.714957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80e67-018e-435f-a69d-91ca0c873b48 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:13.715488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80e67-018e-435f-a69d-91ca0c873b48 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:13.715596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a80e67-018e-435f-a69d-91ca0c873b48 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:13.717139 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 147/295] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:13.723418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b841a-337d-4a5f-8e04-40a1845ebe78 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:13.723852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b841a-337d-4a5f-8e04-40a1845ebe78 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:13.724027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b841a-337d-4a5f-8e04-40a1845ebe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:13.741703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-278b841a-337d-4a5f-8e04-40a1845ebe78 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:13.742905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-278b841a-337d-4a5f-8e04-40a1845ebe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:13.819838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 149/296] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:13.842780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80e67-018e-435f-a69d-91ca0c873b48 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:13.947378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a80e67-018e-435f-a69d-91ca0c873b48 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:13.963794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ab7b-faea-4ca0-8a1c-edaefe2fed2e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:13.964091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ab7b-faea-4ca0-8a1c-edaefe2fed2e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:13.964361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4ab7b-faea-4ca0-8a1c-edaefe2fed2e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:13.966474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 150/297] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:13.973096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ae67e-1593-4daf-b86a-2ff15cdb6d55 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:13.973385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ae67e-1593-4daf-b86a-2ff15cdb6d55 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:13.973664 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ae67e-1593-4daf-b86a-2ff15cdb6d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:13.985567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:13.986372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:13.986656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:13.986932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:13.991461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-215ae67e-1593-4daf-b86a-2ff15cdb6d55 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:13.992648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-215ae67e-1593-4daf-b86a-2ff15cdb6d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:13.997312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:14.005175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:14.006093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:14.007427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 148/298] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:14.013279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:14.075457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 151/299] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:14.088586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ae67e-1593-4daf-b86a-2ff15cdb6d55 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:14.130988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69a6c7-586f-4bed-83c8-1c85e16c7abf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:14.173670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:14.174762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.175042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.175604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.176497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:14.176818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:14.178809 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:14.186619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ae67e-1593-4daf-b86a-2ff15cdb6d55 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:14.191196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 149/300] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:14.199058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:14.226837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:14.227749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.228032 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.228309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.229592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:14.231060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:14.238253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 152/301] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:14.239320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:14.304518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeee1b3-caf0-412f-affb-28095d381917 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:14.338281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:14.339182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.339466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.339735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] PATH_INFO: `/v3/users/e87212751c994600ad46ef1e1a0bbd78` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.346114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac5057-756d-47b7-bb64-b8bce2ed46ff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:14.353294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] RBAC: Authorizing `identity:get_user(user_id=e87212751c994600ad46ef1e1a0bbd78)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:14.354756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:14.356651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 150/302] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:14 2022] GET /identity/v3/users/e87212751c994600ad46ef1e1a0bbd78 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:14.363253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:14.381708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66483b6-9f11-4e23-986d-1dba3e0a82d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:14.382375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66483b6-9f11-4e23-986d-1dba3e0a82d6 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.382657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66483b6-9f11-4e23-986d-1dba3e0a82d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.382929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66483b6-9f11-4e23-986d-1dba3e0a82d6 None admin] PATH_INFO: `/v3/groups` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.383675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66483b6-9f11-4e23-986d-1dba3e0a82d6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:14.385122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66483b6-9f11-4e23-986d-1dba3e0a82d6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:14.461300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80161006-2632-43e7-a7c6-51f592e5289a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:14.474510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 153/303] 10.222.0.49 () {60 vars in 1134 bytes} [Tue May 10 20:50:14 2022] POST /identity/v3/groups => generated 229 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:14.480215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaeac1-e2a1-4af7-b6ce-f600bdce07fe None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.480215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaeac1-e2a1-4af7-b6ce-f600bdce07fe None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.480215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afaeac1-e2a1-4af7-b6ce-f600bdce07fe None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.480215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 154/304] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:14.489322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0b5dd-65b4-4e46-aaa7-144ec7e2f9b3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.489950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0b5dd-65b4-4e46-aaa7-144ec7e2f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.490433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb0b5dd-65b4-4e46-aaa7-144ec7e2f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.509624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bbb0b5dd-65b4-4e46-aaa7-144ec7e2f9b3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:14.511321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bbb0b5dd-65b4-4e46-aaa7-144ec7e2f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:14.511433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:14.512025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.512310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.512586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.513444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] RBAC: Adding query filter params (role.id=b5d48eb189cd4e0da28af8d6f283bef6, user.id=e87212751c994600ad46ef1e1a0bbd78, scope.system=all) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:14.513750 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:14.516240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:14.531732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 151/305] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 20:50:14 2022] GET /identity/v3/role_assignments?user.id=e87212751c994600ad46ef1e1a0bbd78&scope.system=all&role.id=b5d48eb189cd4e0da28af8d6f283bef6 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:14.614241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 155/306] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:14.639396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:14.758563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf36ba-59df-4459-ba9e-3c222fffe243 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:14.797250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae507f8-7fe5-4131-b6ef-387105936759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:14.798363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae507f8-7fe5-4131-b6ef-387105936759 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.798823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae507f8-7fe5-4131-b6ef-387105936759 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.799286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae507f8-7fe5-4131-b6ef-387105936759 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.811273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae507f8-7fe5-4131-b6ef-387105936759 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1ae507f8-7fe5-4131-b6ef-387105936759 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:14.819867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:14.820972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:14.822012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:14.824274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 152/307] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:14.830811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0b5dd-65b4-4e46-aaa7-144ec7e2f9b3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:14.933923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb0b5dd-65b4-4e46-aaa7-144ec7e2f9b3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:14.945826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac216d6-e6c4-4519-8b0b-cfcba0091e41 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.946115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac216d6-e6c4-4519-8b0b-cfcba0091e41 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.946394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac216d6-e6c4-4519-8b0b-cfcba0091e41 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.948024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 153/308] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:50:14.954077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ea6d-d172-4aa1-8c8f-7a5d98f1390c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.954363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ea6d-d172-4aa1-8c8f-7a5d98f1390c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.954637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4ea6d-d172-4aa1-8c8f-7a5d98f1390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.971662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:14.971965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3df4ea6d-d172-4aa1-8c8f-7a5d98f1390c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:14.972760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:14.973143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3df4ea6d-d172-4aa1-8c8f-7a5d98f1390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:14.973348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:14.973780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:14.974683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:14.975153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:14.976779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:14.986001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 156/309] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:14.991874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:15.042802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 154/310] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:15.065648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4ea6d-d172-4aa1-8c8f-7a5d98f1390c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:15.106116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaad0b-767b-4344-8a8c-b37cc0d2a46c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:15.149222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:15.151679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:15.152114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:15.152633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] PATH_INFO: `/v3/users/20405b526a9d47f59ad0ab634b5270ea` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:15.156454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] RBAC: Authorizing `identity:get_user(user_id=20405b526a9d47f59ad0ab634b5270ea)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:15.158057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:15.160576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 157/311] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:14 2022] GET /identity/v3/users/20405b526a9d47f59ad0ab634b5270ea => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:15.166019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:15.188652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4ea6d-d172-4aa1-8c8f-7a5d98f1390c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:15.223189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:15.224057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:15.224458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:15.224835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:15.236243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:15.244013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:15.245150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:15.245956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:15.246589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 155/312] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:15.251801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:15.285504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876aa9b-1159-41cd-a5be-82499468a687 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:15.326183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:15.327403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:15.328403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:15.328833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] PATH_INFO: `/v3/system/users/20405b526a9d47f59ad0ab634b5270ea/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:15.330659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=20405b526a9d47f59ad0ab634b5270ea, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:15.333008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:15.364745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a38a09-5335-49e6-9f9d-48e2e7f6b023 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:15.400954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:15.401692 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:15.401974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:15.402248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:15.403003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:15.403337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:15.404755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:15.413927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 156/313] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:15.419268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:15.422396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 158/314] 10.222.0.49 () {58 vars in 1334 bytes} [Tue May 10 20:50:15 2022] PUT /identity/v3/system/users/20405b526a9d47f59ad0ab634b5270ea/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:50:15.548589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07fdf16-f538-4b89-94bc-9e6f22af513b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:15.585485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:15.586724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:15.587253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:15.587724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] PATH_INFO: `/v3/users/9513be64c49c409eb620091766ee8968` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:15.589169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] RBAC: Authorizing `identity:get_user(user_id=9513be64c49c409eb620091766ee8968)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:15.590849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:15.593089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 157/315] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:15 2022] GET /identity/v3/users/9513be64c49c409eb620091766ee8968 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:15.599179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:15.710056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45f756-f22b-4d89-acd3-30a591e6253a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:15.748622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:15.750218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:15.750923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:15.751474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:15.819661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:15.821405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:15.923198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 159/316] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:15.928450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:16.028773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422de4c4-b3bd-42a1-8bd5-deeddfcfd45b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:16.063627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91432598-8a83-4bf4-a7f8-8af09e9f951b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:16.064760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432598-8a83-4bf4-a7f8-8af09e9f951b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:16.065218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432598-8a83-4bf4-a7f8-8af09e9f951b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:16.065663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91432598-8a83-4bf4-a7f8-8af09e9f951b None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:16.067002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91432598-8a83-4bf4-a7f8-8af09e9f951b None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:16.068774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91432598-8a83-4bf4-a7f8-8af09e9f951b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:16.070947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 158/317] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:15 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:16.076313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:16.176104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef2d56-753b-4704-9d8f-e7f03f729682 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:16.211102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d679249-a030-48b0-b4db-36ac128eade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:16.212107 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d679249-a030-48b0-b4db-36ac128eade9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:16.212564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d679249-a030-48b0-b4db-36ac128eade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:16.213009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d679249-a030-48b0-b4db-36ac128eade9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:16.214012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d679249-a030-48b0-b4db-36ac128eade9 None admin] RBAC: Adding query filter params (role.id=b5d48eb189cd4e0da28af8d6f283bef6, scope.project.id=f6fe6e0792f3432ab55581cdd4965083, user.id=9513be64c49c409eb620091766ee8968) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:16.214512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d679249-a030-48b0-b4db-36ac128eade9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:16.216151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d679249-a030-48b0-b4db-36ac128eade9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:16.223867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 160/318] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:16 2022] GET /identity/v3/role_assignments?user.id=9513be64c49c409eb620091766ee8968&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=b5d48eb189cd4e0da28af8d6f283bef6 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:16.809092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a314fc2-855e-4b6c-ae7e-134d78edebd4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:16.809488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a314fc2-855e-4b6c-ae7e-134d78edebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:16.809661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a314fc2-855e-4b6c-ae7e-134d78edebd4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:16.811066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 159/319] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:16.816825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027e2ba-ddc4-4898-b4fd-7a27b2d938a1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:16.817122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027e2ba-ddc4-4898-b4fd-7a27b2d938a1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:16.817406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027e2ba-ddc4-4898-b4fd-7a27b2d938a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:16.834356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c027e2ba-ddc4-4898-b4fd-7a27b2d938a1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:16.835568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c027e2ba-ddc4-4898-b4fd-7a27b2d938a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:16.858604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d071a-50bf-4034-b8d7-e0eb77a286d0 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:16.858918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d071a-50bf-4034-b8d7-e0eb77a286d0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:16.859660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d071a-50bf-4034-b8d7-e0eb77a286d0 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:16.861728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 160/320] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:50:16.866932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef59ee-0ffd-4d2e-84e6-0310b3266cbb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:16.867472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef59ee-0ffd-4d2e-84e6-0310b3266cbb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:16.867818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef59ee-0ffd-4d2e-84e6-0310b3266cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:16.884363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-29ef59ee-0ffd-4d2e-84e6-0310b3266cbb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:16.885538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-29ef59ee-0ffd-4d2e-84e6-0310b3266cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:16.904977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 161/321] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:16.928148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027e2ba-ddc4-4898-b4fd-7a27b2d938a1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:16.952089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 161/322] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:16.975293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef59ee-0ffd-4d2e-84e6-0310b3266cbb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:17.026880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027e2ba-ddc4-4898-b4fd-7a27b2d938a1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:17.061616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:17.063003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.063314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.063591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.073668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:17.074153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef59ee-0ffd-4d2e-84e6-0310b3266cbb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:17.081371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:17.082395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:17.083452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 162/323] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:17.088131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:17.114913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:17.115958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.116241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.116516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.117691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:17.119154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:17.125644 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 162/324] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:17.126430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:17.189593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbdb1c-87b0-4efd-a728-25af2624cfc2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:17.222902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:17.223666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.223876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.224156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.224906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:17.225215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:17.226607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:17.239166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 163/325] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:17.240078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba75fe4-bc5b-42c2-989b-c472775291c8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:17.240962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:17.273886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174e23-ac76-4494-993e-191d54b17391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:17.274553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174e23-ac76-4494-993e-191d54b17391 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.274836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174e23-ac76-4494-993e-191d54b17391 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.275109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174e23-ac76-4494-993e-191d54b17391 None admin] PATH_INFO: `/v3/groups` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.275836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174e23-ac76-4494-993e-191d54b17391 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:17.277270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174e23-ac76-4494-993e-191d54b17391 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:17.341157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df36e5-0c47-451b-b746-9f789f4e88a9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:17.374016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:17.375397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.375684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.375962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] PATH_INFO: `/v3/users/e87212751c994600ad46ef1e1a0bbd78` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.377254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] RBAC: Authorizing `identity:get_user(user_id=e87212751c994600ad46ef1e1a0bbd78)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:17.378704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:17.380441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 164/326] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:17 2022] GET /identity/v3/users/e87212751c994600ad46ef1e1a0bbd78 => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:17.385839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:17.387668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 163/327] 10.222.0.49 () {60 vars in 1134 bytes} [Tue May 10 20:50:17 2022] POST /identity/v3/groups => generated 226 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:50:17.493002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c712681-3e20-4d56-92b8-fd0a95a3c253 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:17.527582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf148e8-ec2d-41d0-8b96-51a16df3627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:17.528463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf148e8-ec2d-41d0-8b96-51a16df3627b None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.528752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf148e8-ec2d-41d0-8b96-51a16df3627b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.529029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf148e8-ec2d-41d0-8b96-51a16df3627b None admin] PATH_INFO: `/v3/system/users/e87212751c994600ad46ef1e1a0bbd78/roles/b5d48eb189cd4e0da28af8d6f283bef6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.530585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf148e8-ec2d-41d0-8b96-51a16df3627b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e87212751c994600ad46ef1e1a0bbd78, role_id=b5d48eb189cd4e0da28af8d6f283bef6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:17.532768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf148e8-ec2d-41d0-8b96-51a16df3627b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:17.601553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 165/328] 10.222.0.49 () {58 vars in 1334 bytes} [Tue May 10 20:50:17 2022] PUT /identity/v3/system/users/e87212751c994600ad46ef1e1a0bbd78/roles/b5d48eb189cd4e0da28af8d6f283bef6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:50:17.760263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9f05-a20b-4d43-8381-9f0604d5d0dc None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.760556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9f05-a20b-4d43-8381-9f0604d5d0dc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.760748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9f05-a20b-4d43-8381-9f0604d5d0dc None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.762427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 164/329] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:17.769338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad264f-2a1d-4276-8c9f-449e730e30a8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:17.769660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad264f-2a1d-4276-8c9f-449e730e30a8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:17.769894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ad264f-2a1d-4276-8c9f-449e730e30a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:17.787954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e4ad264f-2a1d-4276-8c9f-449e730e30a8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:17.789151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e4ad264f-2a1d-4276-8c9f-449e730e30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:17.858760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 166/330] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:17.881657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd9f05-a20b-4d43-8381-9f0604d5d0dc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:17.984085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd9f05-a20b-4d43-8381-9f0604d5d0dc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:18.018761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:18.019507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:18.019789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:18.020063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:18.030982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:18.038948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:18.041198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:18.043252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 165/331] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:18.048164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad264f-2a1d-4276-8c9f-449e730e30a8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:18.147661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ad264f-2a1d-4276-8c9f-449e730e30a8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:18.182720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:18.183413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:18.183692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:18.183964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:18.184715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:18.185018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:18.186411 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:18.195999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 167/332] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:18.201510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:18.303664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a87d8-ff34-4330-bc04-ea16ce940b68 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:18.338625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac5df5-e01b-497f-8687-9993eb132b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:18.339531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5df5-e01b-497f-8687-9993eb132b02 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:18.339810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5df5-e01b-497f-8687-9993eb132b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:18.340084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac5df5-e01b-497f-8687-9993eb132b02 None admin] PATH_INFO: `/v3/users/20405b526a9d47f59ad0ab634b5270ea` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:18.341292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5df5-e01b-497f-8687-9993eb132b02 None admin] RBAC: Authorizing `identity:get_user(user_id=20405b526a9d47f59ad0ab634b5270ea)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:18.342812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac5df5-e01b-497f-8687-9993eb132b02 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:18.345026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 166/333] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:18 2022] GET /identity/v3/users/20405b526a9d47f59ad0ab634b5270ea => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:18.350739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:18.455416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2e6ac-8350-4542-b197-70307e2bb217 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:18.489644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb791112-1f9b-4f04-a91e-2b7bce0dd4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:18.490301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791112-1f9b-4f04-a91e-2b7bce0dd4b0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:18.490581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791112-1f9b-4f04-a91e-2b7bce0dd4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:18.490854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb791112-1f9b-4f04-a91e-2b7bce0dd4b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:18.491727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791112-1f9b-4f04-a91e-2b7bce0dd4b0 None admin] RBAC: Adding query filter params (role.id=caa01d8eaed74e7a886bc75acdaff590, user.id=20405b526a9d47f59ad0ab634b5270ea, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:18.492039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791112-1f9b-4f04-a91e-2b7bce0dd4b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:18.493499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb791112-1f9b-4f04-a91e-2b7bce0dd4b0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:18.506140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 168/334] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 20:50:18 2022] GET /identity/v3/role_assignments?user.id=20405b526a9d47f59ad0ab634b5270ea&scope.system=all&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 510 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:20.045888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551745-c073-4a68-8570-459acf2d54e6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.046954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551745-c073-4a68-8570-459acf2d54e6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.046954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551745-c073-4a68-8570-459acf2d54e6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.048758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 167/335] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:20.055542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ba57-2bd2-4aae-8959-175f7a4649f3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.055998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ba57-2bd2-4aae-8959-175f7a4649f3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.056082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0ba57-2bd2-4aae-8959-175f7a4649f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.080198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-36d0ba57-2bd2-4aae-8959-175f7a4649f3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:20.081638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36d0ba57-2bd2-4aae-8959-175f7a4649f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:20.141603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb0cf-d16d-4d65-baa8-a5b2e1c52843 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.141929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb0cf-d16d-4d65-baa8-a5b2e1c52843 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.142160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cfb0cf-d16d-4d65-baa8-a5b2e1c52843 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.147218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 168/336] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:20.154029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856bea-37a4-4761-be82-b83bf324d3c8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.154319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856bea-37a4-4761-be82-b83bf324d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.154585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40856bea-37a4-4761-be82-b83bf324d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.180818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 169/337] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:20.188407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-40856bea-37a4-4761-be82-b83bf324d3c8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:20.189642 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-40856bea-37a4-4761-be82-b83bf324d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:20.211024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ba57-2bd2-4aae-8959-175f7a4649f3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:20.293897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 169/338] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:20.359918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856bea-37a4-4761-be82-b83bf324d3c8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:20.406958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0ba57-2bd2-4aae-8959-175f7a4649f3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:20.503790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:20.504979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.505472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.505950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.511157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40856bea-37a4-4761-be82-b83bf324d3c8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:20.547982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:20.559168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:20.560147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 10 20:50:20.560994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:20.567220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:20.567220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.567220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.567220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.569292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 170/339] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:20.574657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:20.580757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:20.595240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:20.596224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:20.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 170/340] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:20.607244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:20.760686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a26b5-744e-4b72-a767-f8343670949e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:20.762032 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302805e-c03f-46f0-99b1-48192964792a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:20.806396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:20.807448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.808024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.808582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.809853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:20.810370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:20.815887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:20.816289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:20.816950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:20.817395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:20.817820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:20.818797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:20.819323 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:20.821019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:20.825398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 171/341] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:20.831809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:20.834774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 171/342] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:20.840322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:20.976175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f343b9-8b93-4849-bf0e-3d0f3cf4da34 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.020787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0f9d1-2e5c-4f63-90e6-060eaed42172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:21.021823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0f9d1-2e5c-4f63-90e6-060eaed42172 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.022289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0f9d1-2e5c-4f63-90e6-060eaed42172 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.022748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0f9d1-2e5c-4f63-90e6-060eaed42172 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.069720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875de710-6d93-4e30-8ba7-6ebff22fb8b7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.132479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0f9d1-2e5c-4f63-90e6-060eaed42172 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:21.133553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:21.134528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.134891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.135257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0f9d1-2e5c-4f63-90e6-060eaed42172 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:21.135382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] PATH_INFO: `/v3/users/e87212751c994600ad46ef1e1a0bbd78` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.139978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] RBAC: Authorizing `identity:get_user(user_id=e87212751c994600ad46ef1e1a0bbd78)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:21.142356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:21.144510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 172/343] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:50:20 2022] GET /identity/v3/users/e87212751c994600ad46ef1e1a0bbd78 => generated 293 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:21.151000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:21.245741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 172/344] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:50:21.251452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8926e-40a1-4b86-9f79-98516db29f37 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.252025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8926e-40a1-4b86-9f79-98516db29f37 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.252484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e8926e-40a1-4b86-9f79-98516db29f37 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.254136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 173/345] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:21.256363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8926e-40a1-4b86-9f79-98516db29f37 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:21.265939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754e723-7886-4d21-9285-dc4181f5b255 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.310613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc315a6-3da5-43d6-9516-ca2ae138fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:21.312647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc315a6-3da5-43d6-9516-ca2ae138fe8b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.313199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc315a6-3da5-43d6-9516-ca2ae138fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.313931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc315a6-3da5-43d6-9516-ca2ae138fe8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.315002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc315a6-3da5-43d6-9516-ca2ae138fe8b None admin] RBAC: Adding query filter params (role.id=b5d48eb189cd4e0da28af8d6f283bef6, user.id=e87212751c994600ad46ef1e1a0bbd78, scope.system=all) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:21.315651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc315a6-3da5-43d6-9516-ca2ae138fe8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:21.317650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc315a6-3da5-43d6-9516-ca2ae138fe8b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:21.334064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 173/346] 10.222.0.49 () {56 vars in 1308 bytes} [Tue May 10 20:50:21 2022] GET /identity/v3/role_assignments?user.id=e87212751c994600ad46ef1e1a0bbd78&scope.system=all&role.id=b5d48eb189cd4e0da28af8d6f283bef6 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:21.336006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17842fc-d610-490c-b18e-cd4bdc2f706a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.336513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17842fc-d610-490c-b18e-cd4bdc2f706a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.336990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17842fc-d610-490c-b18e-cd4bdc2f706a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.358667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a17842fc-d610-490c-b18e-cd4bdc2f706a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:21.361464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a17842fc-d610-490c-b18e-cd4bdc2f706a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:21.418490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e8926e-40a1-4b86-9f79-98516db29f37 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.460222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5facee39-13f0-4c45-b275-7fff36766731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:21.461474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facee39-13f0-4c45-b275-7fff36766731 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.461950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facee39-13f0-4c45-b275-7fff36766731 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.462468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5facee39-13f0-4c45-b275-7fff36766731 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.470390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facee39-13f0-4c45-b275-7fff36766731 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:21.472266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5facee39-13f0-4c45-b275-7fff36766731 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:21.475181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 174/347] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:21 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:21.476885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42697-0eca-4ef1-85c3-9fb5ac62d94a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.478743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42697-0eca-4ef1-85c3-9fb5ac62d94a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.483016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e42697-0eca-4ef1-85c3-9fb5ac62d94a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.486498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 175/348] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:21 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:21.493381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 174/349] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:21.494414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c189-6f9a-47b6-ad98-dcc9450781df None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.494724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c189-6f9a-47b6-ad98-dcc9450781df None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.494984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7c189-6f9a-47b6-ad98-dcc9450781df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.495269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17842fc-d610-490c-b18e-cd4bdc2f706a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:21.529029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-94e7c189-6f9a-47b6-ad98-dcc9450781df None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:21.530754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-94e7c189-6f9a-47b6-ad98-dcc9450781df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:21.650535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17842fc-d610-490c-b18e-cd4bdc2f706a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.688466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 176/350] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:21.689412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c189-6f9a-47b6-ad98-dcc9450781df None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:21.690599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:21.691497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.691788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.692064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.698996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:21.700671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:21.707600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 175/351] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:21 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:21.708956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:21.804435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7c189-6f9a-47b6-ad98-dcc9450781df None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.822302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5011c3-961b-4962-bd32-57cfe6ba0f42 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.839814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:21.840629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.840914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.841189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.852777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:21.860646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:21.861309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:21.861594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:21.861870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:21.862056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:21.862926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:21.863849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:21.864470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=0e4b5422852e4a658bdd2ef28748da83) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:21.864470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:21.864591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 177/352] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:21.864591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:21.864717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:21.871514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 176/353] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:21 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:21.872353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:21.978853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc8f57-3a25-44cf-9014-62a421108e20 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:21.986201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419b080-4da4-470f-abb7-c6d643d79032 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.017138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.017970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.018255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.018534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.024315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.025051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.025341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.025623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.026397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:22.026710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.028202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.031336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:22.038386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 177/354] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:22.043686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:22.045944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:22.048090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 178/355] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:22.049659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.055225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.157616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5091-d6d8-43e7-897c-53113815389b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.161203 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9204cd1-518d-49da-8e15-44e851898886 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.194410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.195239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.195638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.195980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.196728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.197403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.197687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.197967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.198731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:22.199040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.200491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.210029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 179/356] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:22.216088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.270847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.272378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.363960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b02747-241b-4d1d-87c9-c44f666e87ad None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.376081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 178/357] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:22.386565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.405272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.406707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.406998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.407310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.479630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.481101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.532456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02472f9a-67de-4d4b-bdfa-d0485950ba4b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.582987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.583891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.584174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.584451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.585665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.587166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.588233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 180/358] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:22.588852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 179/359] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:22.593827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.613367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.704757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf119f-8ad9-484d-8b18-38027c0fd727 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.741677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc5ad20-7b23-4e80-aba5-25b603aaeda8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.746793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d1c0b-b52f-4877-9365-70096d069ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.746982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1c0b-b52f-4877-9365-70096d069ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.747290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1c0b-b52f-4877-9365-70096d069ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.747568 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d1c0b-b52f-4877-9365-70096d069ae0 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.748780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d1c0b-b52f-4877-9365-70096d069ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.750907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d1c0b-b52f-4877-9365-70096d069ae0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.756955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 181/360] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:22.756955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a951d-58cf-4e9d-9372-676c16cfda3a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.756955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a951d-58cf-4e9d-9372-676c16cfda3a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.756955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a951d-58cf-4e9d-9372-676c16cfda3a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.757466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 182/361] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:22.758179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a951d-58cf-4e9d-9372-676c16cfda3a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.801517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3554b-81b9-451b-974a-bac0efb6d337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.802928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3554b-81b9-451b-974a-bac0efb6d337 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.803732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3554b-81b9-451b-974a-bac0efb6d337 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.804495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3554b-81b9-451b-974a-bac0efb6d337 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.806410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3554b-81b9-451b-974a-bac0efb6d337 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.808418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3554b-81b9-451b-974a-bac0efb6d337 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.810466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 180/362] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:22.813527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d1b34-a157-4035-abd4-a6579d9f50c8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.814072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d1b34-a157-4035-abd4-a6579d9f50c8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.814584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d1b34-a157-4035-abd4-a6579d9f50c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.834946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0f6d1b34-a157-4035-abd4-a6579d9f50c8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:22.836983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0f6d1b34-a157-4035-abd4-a6579d9f50c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:22.895475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a951d-58cf-4e9d-9372-676c16cfda3a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:22.931896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 181/363] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:22.932758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d1b34-a157-4035-abd4-a6579d9f50c8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:22.944151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:22.945353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:22.945851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:22.946337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:22.951889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:22.957293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:22.961666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 183/364] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:22.967082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.067037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d1b34-a157-4035-abd4-a6579d9f50c8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.098939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7bea5-334c-4a1f-9f89-267924a75e95 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.104282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.105213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.105498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.105780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.106623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=f6fe6e0792f3432ab55581cdd4965083) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:23.106944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:23.108427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:23.118134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 182/365] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:23.118951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.144930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf2f25-ac67-4008-9695-e71fbbbe68b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.145822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf2f25-ac67-4008-9695-e71fbbbe68b3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.146111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf2f25-ac67-4008-9695-e71fbbbe68b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.146389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf2f25-ac67-4008-9695-e71fbbbe68b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.160887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf2f25-ac67-4008-9695-e71fbbbe68b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6dbf2f25-ac67-4008-9695-e71fbbbe68b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:23.169462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:23.171179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:23.172664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:23.175246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 184/366] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:23.176977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad9df-1de2-44f6-a86d-16a27cc0d6f1 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.179566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad9df-1de2-44f6-a86d-16a27cc0d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.180126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad9df-1de2-44f6-a86d-16a27cc0d6f1 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.181624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 185/367] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:23.182401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad9df-1de2-44f6-a86d-16a27cc0d6f1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.270056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c168a7f-0e46-4459-8aee-e2f35318b148 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.302301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad9df-1de2-44f6-a86d-16a27cc0d6f1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.320170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ffde07-4307-40b7-8d27-22b6102c5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.321427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffde07-4307-40b7-8d27-22b6102c5e7c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.321925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffde07-4307-40b7-8d27-22b6102c5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.322765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ffde07-4307-40b7-8d27-22b6102c5e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.323908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffde07-4307-40b7-8d27-22b6102c5e7c None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=0e4b5422852e4a658bdd2ef28748da83) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:23.324438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffde07-4307-40b7-8d27-22b6102c5e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:23.326802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ffde07-4307-40b7-8d27-22b6102c5e7c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:23.339718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 183/368] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:23.341525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e58ac-abae-4b19-a93b-5a0df14daeef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.342060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e58ac-abae-4b19-a93b-5a0df14daeef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.342565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e58ac-abae-4b19-a93b-5a0df14daeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.363752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-661e58ac-abae-4b19-a93b-5a0df14daeef None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:23.365298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-661e58ac-abae-4b19-a93b-5a0df14daeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:23.366778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.367505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.367792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.368071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.368855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:23.369162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:23.370563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:23.389793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 186/369] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:23.391218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.449535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 184/370] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:23.474395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e58ac-abae-4b19-a93b-5a0df14daeef None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.500395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56725c56-f2b5-4629-aa51-03b8a36f113f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.536992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.537583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.537869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.538208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.588389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e58ac-abae-4b19-a93b-5a0df14daeef None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.615182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:23.616669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:23.630695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.631997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.632485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.632963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.648632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:23.665029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:23.665998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:23.666846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:23.669593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 185/371] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:23.675828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.720390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 187/372] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:23.726006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.817356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783a244-dbf1-44b8-b2b4-a59852f34b49 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.831889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0fa19-b4a3-48dd-a198-5d1899c338b4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:23.853491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.854503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.855014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.855551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.856510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:23.857020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:23.858625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:23.868230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:23.869100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:23.869469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:23.869659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:23.869865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 186/373] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:23.874356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:23.874356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:23.874918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 188/374] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:23.875985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.881464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:23.989609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea4e79-0ad8-4973-b1b5-2b0decff70fe None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:24.004335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190f6cb-8822-40cd-bebd-46cf404d26c5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:24.025170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:24.026169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:24.026676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:24.027205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:24.042191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:24.043248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:24.043536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:24.043814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:24.047329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:24.047771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:24.049976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 189/375] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:24.055455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:24.171112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0dc44-1c28-48ea-a118-496f5c668262 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:24.205958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:24.207562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:24.213437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:24.214376 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:24.214894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:24.215399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:24.216929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=f6fe6e0792f3432ab55581cdd4965083) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:24.217469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:24.220524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:24.228940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 190/376] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:24 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:24.322148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 187/377] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:24.328534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:24.436321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7288b8d-ce18-488d-b765-ee42a2e6bb14 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:24.473843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:24.475087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:24.475602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:24.476093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] PATH_INFO: `/v3/projects/0505b6fc7edf412485d1ca7159b626ae` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:24.477546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] RBAC: Authorizing `identity:get_project(project_id=0505b6fc7edf412485d1ca7159b626ae)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:24.479246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:24.481508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 191/378] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:24 2022] GET /identity/v3/projects/0505b6fc7edf412485d1ca7159b626ae => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:24.487676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:24.598586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d777c75-1eaf-4c68-a21e-f258fafd3586 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:24.635533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d53f74-9b4e-40eb-84a0-51e912699a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:24.636394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53f74-9b4e-40eb-84a0-51e912699a2a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:24.636678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53f74-9b4e-40eb-84a0-51e912699a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:24.636958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d53f74-9b4e-40eb-84a0-51e912699a2a None admin] PATH_INFO: `/v3/groups/1564d271d01243ec8d7c47f349dac37e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:24.642581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d53f74-9b4e-40eb-84a0-51e912699a2a None admin] RBAC: Authorizing `identity:get_group(group_id=1564d271d01243ec8d7c47f349dac37e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:24.644150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d53f74-9b4e-40eb-84a0-51e912699a2a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:24.646150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 188/379] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:24 2022] GET /identity/v3/groups/1564d271d01243ec8d7c47f349dac37e => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:24.651925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:24.757668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe56a90-373b-41df-96a7-a12a1fb081d5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:24.794055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4ac280-1b36-4a5d-a327-7407455a7946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:24.794736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac280-1b36-4a5d-a327-7407455a7946 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:24.795308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac280-1b36-4a5d-a327-7407455a7946 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:24.795671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4ac280-1b36-4a5d-a327-7407455a7946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:24.797204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ac280-1b36-4a5d-a327-7407455a7946 None admin] RBAC: Adding query filter params (group.id=1564d271d01243ec8d7c47f349dac37e, role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=0505b6fc7edf412485d1ca7159b626ae) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:24.797520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ac280-1b36-4a5d-a327-7407455a7946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:24.799153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4ac280-1b36-4a5d-a327-7407455a7946 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:24.806055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 192/380] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:24 2022] GET /identity/v3/role_assignments?group.id=1564d271d01243ec8d7c47f349dac37e&scope.project.id=0505b6fc7edf412485d1ca7159b626ae&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 260 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:25.032615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b711-a50b-45f4-b467-38465b32868f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:25.033273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b711-a50b-45f4-b467-38465b32868f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:25.033755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b711-a50b-45f4-b467-38465b32868f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:25.035653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 189/381] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:25.041685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ecf24-931b-4c04-94cc-85319248c4d7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:25.041977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ecf24-931b-4c04-94cc-85319248c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:25.042262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ecf24-931b-4c04-94cc-85319248c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:25.061457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e58ecf24-931b-4c04-94cc-85319248c4d7 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:25.062764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e58ecf24-931b-4c04-94cc-85319248c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:25.147107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 193/382] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:25.185512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324b711-a50b-45f4-b467-38465b32868f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:25.334112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324b711-a50b-45f4-b467-38465b32868f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:25.391030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:25.392311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:25.392803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:25.393269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:25.410330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:25.423575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:25.424543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:25.425339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:25.428309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 190/383] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:25.434237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ecf24-931b-4c04-94cc-85319248c4d7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:25.574751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ecf24-931b-4c04-94cc-85319248c4d7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:25.631808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:25.632491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:25.632775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:25.633052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:25.633808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:25.634115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:25.635528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:25.644631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 194/384] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:25.651009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:25.779784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984632ff-de0d-4d14-b462-3b91e0f38e4c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:25.819511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:25.820390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:25.820676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:25.820958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:25.822234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:25.823829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:25.825881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 191/385] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:25 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:25.832238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:25.980174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fdcc4-6921-467d-bb50-a1f370c35f5e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:26.023262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96309952-1d8e-49f0-8246-fc19359e8dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:26.024535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309952-1d8e-49f0-8246-fc19359e8dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.025024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309952-1d8e-49f0-8246-fc19359e8dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.025498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96309952-1d8e-49f0-8246-fc19359e8dd2 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.032252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96309952-1d8e-49f0-8246-fc19359e8dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:26.034081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96309952-1d8e-49f0-8246-fc19359e8dd2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:26.036449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 195/386] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:25 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:26.042006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:26.054445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017f70-1ea8-4bb5-8e7c-9cb844bbb147 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.054788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017f70-1ea8-4bb5-8e7c-9cb844bbb147 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.054998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e017f70-1ea8-4bb5-8e7c-9cb844bbb147 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.056675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 196/387] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:50:26.065177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d6a2-9dfd-4307-bf0b-82def7d1e3b9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.065472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d6a2-9dfd-4307-bf0b-82def7d1e3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.065756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7d6a2-9dfd-4307-bf0b-82def7d1e3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.098297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4fe7d6a2-9dfd-4307-bf0b-82def7d1e3b9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:26.099526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4fe7d6a2-9dfd-4307-bf0b-82def7d1e3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:26.198498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f554e-d9c3-4d2d-b884-31258c33cb69 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:26.238751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:26.239586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.239870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.240195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.242546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 197/388] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:26.246574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b5422852e4a658bdd2ef28748da83, group_id=dbb330a9947544dfaa9c0b0e0834fa99, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:26.248127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:26.275430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d6a2-9dfd-4307-bf0b-82def7d1e3b9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:26.340430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 192/389] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 20:50:26 2022] PUT /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:26.391690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7d6a2-9dfd-4307-bf0b-82def7d1e3b9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:26.432137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:26.432959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.433241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.433527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.445783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:26.458068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:26.459052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:26.459930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 198/390] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:26.466492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:26.640947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae1451-1a81-496c-8235-bfd89d7cf335 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:26.689571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca20199-2424-4af9-9cba-972387e0c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:26.690309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca20199-2424-4af9-9cba-972387e0c33a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.690595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca20199-2424-4af9-9cba-972387e0c33a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.690932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca20199-2424-4af9-9cba-972387e0c33a None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.691710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca20199-2424-4af9-9cba-972387e0c33a None admin] RBAC: Adding query filter params (name=member) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:26.692017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca20199-2424-4af9-9cba-972387e0c33a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:26.693417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca20199-2424-4af9-9cba-972387e0c33a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:26.710115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 193/391] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:26.715795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:26.826220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5ddfa-0428-46f0-8e20-84c0f60e3a39 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.826559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5ddfa-0428-46f0-8e20-84c0f60e3a39 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.826789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5ddfa-0428-46f0-8e20-84c0f60e3a39 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.829027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 194/392] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:26.834889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72780fb-2aca-4a25-b331-747961dffda2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.835187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72780fb-2aca-4a25-b331-747961dffda2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.835476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72780fb-2aca-4a25-b331-747961dffda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.854324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2c370-dba4-4948-8d26-37af88b4c777 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:26.862644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d72780fb-2aca-4a25-b331-747961dffda2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:26.863892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d72780fb-2aca-4a25-b331-747961dffda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:26.951866 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 195/393] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:26.961766 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:26.962648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:26.962933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:26.963244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:26.970191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:26.971695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:26.973364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 199/394] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:26 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:26.980311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72780fb-2aca-4a25-b331-747961dffda2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.001215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.209827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12efb6-2f21-404a-a694-52daf6572418 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.216767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72780fb-2aca-4a25-b331-747961dffda2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.248769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:27.250261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.250648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.251113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.253096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:27.253963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.254245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.254522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.255790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:27.257264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:27.259578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 196/395] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:26 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:27.263292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:27.266575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:27.271918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:27.272831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:27.274243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 200/396] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:27.279286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.375447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a717f-fea2-46d9-9f14-6a04b54c6ebd None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.387363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e27e09-6b9f-4d82-bd55-fbc4710d7e9f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.413105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:27.414014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.414293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.414569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.416739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe6e0792f3432ab55581cdd4965083, group_id=dbb330a9947544dfaa9c0b0e0834fa99, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:27.418206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:27.423386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:27.424059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.424341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.424611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.425365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:27.425671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:27.427348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:27.436694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 201/397] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:27.443429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.482037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 197/398] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 20:50:27 2022] PUT /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:27.563242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a444e-2044-417c-b952-b6b0ebb9ef1b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.614776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc9ffe-ac5c-409b-a91e-69c525a50a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:27.616092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9ffe-ac5c-409b-a91e-69c525a50a91 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.616556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9ffe-ac5c-409b-a91e-69c525a50a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.617056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc9ffe-ac5c-409b-a91e-69c525a50a91 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.618575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc9ffe-ac5c-409b-a91e-69c525a50a91 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:27.623342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc9ffe-ac5c-409b-a91e-69c525a50a91 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:27.625892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 202/399] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:27 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:27.631669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.656726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697c3f7-cd0f-40c8-8cd5-680057eecb7c None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.657018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697c3f7-cd0f-40c8-8cd5-680057eecb7c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.657304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697c3f7-cd0f-40c8-8cd5-680057eecb7c None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.658982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 203/400] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:27.664708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df18f7-1222-482b-a0d8-2b82fd5d647b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.665004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df18f7-1222-482b-a0d8-2b82fd5d647b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.665286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df18f7-1222-482b-a0d8-2b82fd5d647b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.683636 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d5df18f7-1222-482b-a0d8-2b82fd5d647b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:27.684860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d5df18f7-1222-482b-a0d8-2b82fd5d647b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:27.785056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 204/401] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:27.785265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7879dc-feca-494b-8109-698ce8b87e75 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.815745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df18f7-1222-482b-a0d8-2b82fd5d647b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.828313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:27.829749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.830041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.830322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:27.832080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:27.833855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:27.836595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 198/402] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:27 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:27.841842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:27.937403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df18f7-1222-482b-a0d8-2b82fd5d647b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.973257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eff495-6db2-4fd0-b46f-bba4fab94d34 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:27.984431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1829b232-8360-4104-b08f-8431f7089270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:27.985341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829b232-8360-4104-b08f-8431f7089270 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:27.985526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829b232-8360-4104-b08f-8431f7089270 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:27.985795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1829b232-8360-4104-b08f-8431f7089270 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.003664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1829b232-8360-4104-b08f-8431f7089270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1829b232-8360-4104-b08f-8431f7089270 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:28.011932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:28.012842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:28.014199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 205/403] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:28.014874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c209a-5d68-40d7-9f64-a3a42a66010f None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.014971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c209a-5d68-40d7-9f64-a3a42a66010f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.019391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c209a-5d68-40d7-9f64-a3a42a66010f None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.021102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 206/404] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:28.022914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c209a-5d68-40d7-9f64-a3a42a66010f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:28.027899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25674b38-4e11-4d74-ae9a-564339c084a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.029083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25674b38-4e11-4d74-ae9a-564339c084a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.029584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25674b38-4e11-4d74-ae9a-564339c084a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.030057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25674b38-4e11-4d74-ae9a-564339c084a5 None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.033672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25674b38-4e11-4d74-ae9a-564339c084a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e4b5422852e4a658bdd2ef28748da83, group_id=dbb330a9947544dfaa9c0b0e0834fa99, role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:28.035416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25674b38-4e11-4d74-ae9a-564339c084a5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:28.096285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 199/405] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 20:50:27 2022] PUT /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:50:28.097719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11562b25-a836-48a7-a7f7-badd19f51376 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.098012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11562b25-a836-48a7-a7f7-badd19f51376 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.098290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11562b25-a836-48a7-a7f7-badd19f51376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.119628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-11562b25-a836-48a7-a7f7-badd19f51376 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:28.120705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11562b25-a836-48a7-a7f7-badd19f51376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:28.164415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c209a-5d68-40d7-9f64-a3a42a66010f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:28.206597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.207441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.207824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.208270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.209257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:28.209610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:28.210955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 200/406] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:28.212966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:28.221858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 207/407] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:28.227294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11562b25-a836-48a7-a7f7-badd19f51376 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:28.240839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:28.357017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adef804-98b5-4178-9902-ce3011623ba7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:28.359617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11562b25-a836-48a7-a7f7-badd19f51376 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:28.403312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.404744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.406678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.407558 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.408217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.409255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.410269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.410907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.413599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:28.418172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:28.420665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 201/408] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:28 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:28.426880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:28.431489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:28.448451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:28.449497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:28.450315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:28.460102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 208/409] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:28.464789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:28.617088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17077350-c131-4ea9-8afc-f9e02fdc7f0d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:28.653259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5773e5a-1410-48b9-8d37-c1201acc7294 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:28.657525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.658567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.658862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.659167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.661728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:28.663225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:28.665313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 202/410] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:28 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:28.672715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:28.735903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.736598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.736882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.737155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.737916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:28.738220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:28.739639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:28.751722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 209/411] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:28.760186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:28.779743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872a0e1-fedd-4ced-8300-36dcf57dacd9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:28.817777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.818667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.819007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.819321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.821623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] RBAC: Authorizing `identity:create_grant(project_id=f6fe6e0792f3432ab55581cdd4965083, group_id=dbb330a9947544dfaa9c0b0e0834fa99, role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:28.823095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:28.901348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f108b7-959f-440d-9dee-0eb606811841 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:28.937627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:28.940076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:28.940365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:28.940643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] PATH_INFO: `/v3/groups/1564d271d01243ec8d7c47f349dac37e` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:28.941493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 203/412] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 20:50:28 2022] PUT /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083/groups/dbb330a9947544dfaa9c0b0e0834fa99/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:50:28.941914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] RBAC: Authorizing `identity:get_group(group_id=1564d271d01243ec8d7c47f349dac37e)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:28.943844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:28.946037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 210/413] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:28 2022] GET /identity/v3/groups/1564d271d01243ec8d7c47f349dac37e => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:28.951548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:29.107285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a003d0-53da-4367-99c4-ec3e27ad0815 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:29.151184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276749e-9503-4a17-897f-858bf0bdc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:29.152127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276749e-9503-4a17-897f-858bf0bdc0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:29.152345 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276749e-9503-4a17-897f-858bf0bdc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:29.152620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276749e-9503-4a17-897f-858bf0bdc0b1 None admin] PATH_INFO: `/v3/projects/0505b6fc7edf412485d1ca7159b626ae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:29.153929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276749e-9503-4a17-897f-858bf0bdc0b1 None admin] RBAC: Authorizing `identity:get_project(project_id=0505b6fc7edf412485d1ca7159b626ae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:29.155491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276749e-9503-4a17-897f-858bf0bdc0b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:29.157805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 204/414] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:28 2022] GET /identity/v3/projects/0505b6fc7edf412485d1ca7159b626ae => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:29.163359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:29.276459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c0ae8-59e0-4e7f-b26c-ff5eda1baa14 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:29.310698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dc3a5-8e56-456b-a2c1-fecc77cc36d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:29.311614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dc3a5-8e56-456b-a2c1-fecc77cc36d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:29.312006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dc3a5-8e56-456b-a2c1-fecc77cc36d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:29.312295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dc3a5-8e56-456b-a2c1-fecc77cc36d9 None admin] PATH_INFO: `/v3/projects/0505b6fc7edf412485d1ca7159b626ae/groups/1564d271d01243ec8d7c47f349dac37e/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:29.314302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dc3a5-8e56-456b-a2c1-fecc77cc36d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0505b6fc7edf412485d1ca7159b626ae, group_id=1564d271d01243ec8d7c47f349dac37e, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:29.315800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dc3a5-8e56-456b-a2c1-fecc77cc36d9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:29.410697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 211/415] 10.222.0.49 () {58 vars in 1442 bytes} [Tue May 10 20:50:29 2022] PUT /identity/v3/projects/0505b6fc7edf412485d1ca7159b626ae/groups/1564d271d01243ec8d7c47f349dac37e/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:50:29.722286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88536f-a371-4eab-95e9-e1702bfecb66 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:29.723291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88536f-a371-4eab-95e9-e1702bfecb66 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:29.723810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88536f-a371-4eab-95e9-e1702bfecb66 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:29.725659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 205/416] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:29.731650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24897-43e8-4940-88a2-ab5973573972 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:29.732077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24897-43e8-4940-88a2-ab5973573972 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:29.732253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d24897-43e8-4940-88a2-ab5973573972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:29.755759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c7d24897-43e8-4940-88a2-ab5973573972 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:29.757020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c7d24897-43e8-4940-88a2-ab5973573972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:29.849779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 212/417] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:29.885673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88536f-a371-4eab-95e9-e1702bfecb66 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:30.023845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88536f-a371-4eab-95e9-e1702bfecb66 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:30.066688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:30.067573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.067854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.068127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.083293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:30.090940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:30.091878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:30.092709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 206/418] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:30.098033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d24897-43e8-4940-88a2-ab5973573972 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:30.251303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d24897-43e8-4940-88a2-ab5973573972 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:30.297578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:30.298223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.298506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.298779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.299572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:30.299879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:30.301244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:30.315368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 213/419] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:30.320394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:30.439347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69011-61a5-4d2d-9bcd-5a722ea174c0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:30.478585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c70508-9e5e-486a-9e93-d8164feeb1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:30.479273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70508-9e5e-486a-9e93-d8164feeb1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.479556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70508-9e5e-486a-9e93-d8164feeb1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.479836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c70508-9e5e-486a-9e93-d8164feeb1b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.583465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c70508-9e5e-486a-9e93-d8164feeb1b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:30.584913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c70508-9e5e-486a-9e93-d8164feeb1b5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:30.727881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 207/420] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:30.733008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:30.779004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789255ee-cbb3-40c8-8604-d4dc963ddc77 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.779344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789255ee-cbb3-40c8-8604-d4dc963ddc77 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.779584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789255ee-cbb3-40c8-8604-d4dc963ddc77 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.783401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 208/421] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:30.783401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165194a1-ca24-4191-bc09-62be3957211d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.783401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165194a1-ca24-4191-bc09-62be3957211d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.783401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165194a1-ca24-4191-bc09-62be3957211d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.784118 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 209/422] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:30.788078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0719d-5f5d-4b7b-b340-0815ad022c0a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.788369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0719d-5f5d-4b7b-b340-0815ad022c0a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.788633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0719d-5f5d-4b7b-b340-0815ad022c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.808801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-aba0719d-5f5d-4b7b-b340-0815ad022c0a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:30.809967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-aba0719d-5f5d-4b7b-b340-0815ad022c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:30.850359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2360825-af60-4e59-bec8-36c09b9f3aa5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:30.885278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e2f7e0-66c9-4a70-aa55-09cba48dfbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:30.887261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2f7e0-66c9-4a70-aa55-09cba48dfbea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.887808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2f7e0-66c9-4a70-aa55-09cba48dfbea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.888468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e2f7e0-66c9-4a70-aa55-09cba48dfbea None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.890841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2f7e0-66c9-4a70-aa55-09cba48dfbea None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:30.892633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e2f7e0-66c9-4a70-aa55-09cba48dfbea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:30.894666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 214/423] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:30 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:30.896315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc87dbb-24b0-42e7-80fe-046e05e45e74 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:30.896838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc87dbb-24b0-42e7-80fe-046e05e45e74 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:30.897326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc87dbb-24b0-42e7-80fe-046e05e45e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:30.899275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 210/424] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:30.900409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0719d-5f5d-4b7b-b340-0815ad022c0a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:30.928566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ccc87dbb-24b0-42e7-80fe-046e05e45e74 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:30.930361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ccc87dbb-24b0-42e7-80fe-046e05e45e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:31.019471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 215/425] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:31.020328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc87dbb-24b0-42e7-80fe-046e05e45e74 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.024767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0719d-5f5d-4b7b-b340-0815ad022c0a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.060092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.061623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.062719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.063388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.065566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:31.067812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:31.070393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 211/426] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:30 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:31.071487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.147540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc87dbb-24b0-42e7-80fe-046e05e45e74 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.182850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de014de8-12e1-4d43-8e30-04fed5b75120 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.192877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.194391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.195205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.195812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.209624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:31.219677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:31.220583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:31.221409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:31.222026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.222026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.222026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.222026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.224820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 216/427] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:31.225803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.235694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:31.243674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:31.244572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 10 20:50:31.245375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:31.247737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 212/428] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:31.248712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.337744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d7756-b4ce-45f4-9b1a-43276ceb429c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.349579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be511c78-179f-49e0-a997-a16af475a253 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.371999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.372689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.372977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.373255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.374295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=0e4b5422852e4a658bdd2ef28748da83) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:31.374538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:31.376131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:31.382202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 217/429] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:31.383000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.397634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.398698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.399542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.400017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.402245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:31.404593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:31.406369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:31.427349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 213/430] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:31.431444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.555151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22326f0-ba12-4d19-aef9-a30fb58dfeda None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.582680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a941-30b6-4707-847f-f5d54c59236b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.589500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.590831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.590831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.590831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.591538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] RBAC: Adding query filter params (name=member) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:31.591845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:31.593395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:31.603103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 218/431] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:31.609155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.630839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c0c3-d8bf-44c7-9860-b4db06665d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.631969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c0c3-d8bf-44c7-9860-b4db06665d7a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.632470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c0c3-d8bf-44c7-9860-b4db06665d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.632988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c0c3-d8bf-44c7-9860-b4db06665d7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.705472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c0c3-d8bf-44c7-9860-b4db06665d7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:31.707292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c0c3-d8bf-44c7-9860-b4db06665d7a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:31.713159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953b20b-86b8-426f-8375-f28885e8e10b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.754276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f24802-e12b-4287-90d8-2711188f0cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:31.754276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24802-e12b-4287-90d8-2711188f0cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.754953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24802-e12b-4287-90d8-2711188f0cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.754953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f24802-e12b-4287-90d8-2711188f0cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.837569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 214/432] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:31.839692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aff31-9524-477e-b93c-932e197160cf None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.840046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aff31-9524-477e-b93c-932e197160cf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.840417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67aff31-9524-477e-b93c-932e197160cf None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.842323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 215/433] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:31.844897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aff31-9524-477e-b93c-932e197160cf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:31.848567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f24802-e12b-4287-90d8-2711188f0cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:31.850344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f24802-e12b-4287-90d8-2711188f0cb5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:31.972725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 219/434] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:50:31.974058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224c0d-a2be-4b35-aa7e-db9158b33ce2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:31.974431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224c0d-a2be-4b35-aa7e-db9158b33ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:31.974796 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224c0d-a2be-4b35-aa7e-db9158b33ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:31.975597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67aff31-9524-477e-b93c-932e197160cf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:31.992816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-37224c0d-a2be-4b35-aa7e-db9158b33ce2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:31.994199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-37224c0d-a2be-4b35-aa7e-db9158b33ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:32.025989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.026851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.027171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.027480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] PATH_INFO: `/v3/projects/0e4b5422852e4a658bdd2ef28748da83` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.028662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] RBAC: Authorizing `identity:get_project(project_id=0e4b5422852e4a658bdd2ef28748da83)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.030114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.032458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 216/435] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:31 2022] GET /identity/v3/projects/0e4b5422852e4a658bdd2ef28748da83 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:32.033235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.071454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 220/436] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:32.072306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37224c0d-a2be-4b35-aa7e-db9158b33ce2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.137564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07757a12-2c7b-4f64-9c77-03ec46efe94b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.166213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37224c0d-a2be-4b35-aa7e-db9158b33ce2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.170167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74701eb1-92ed-47b6-b960-5ce503b28b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.171025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74701eb1-92ed-47b6-b960-5ce503b28b45 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.172279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74701eb1-92ed-47b6-b960-5ce503b28b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.172565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74701eb1-92ed-47b6-b960-5ce503b28b45 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.173757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74701eb1-92ed-47b6-b960-5ce503b28b45 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.175253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74701eb1-92ed-47b6-b960-5ce503b28b45 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.176934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 217/437] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:32.178457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad2a8-654e-4ae4-b44e-17231c7f61f4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.178737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad2a8-654e-4ae4-b44e-17231c7f61f4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.179009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fad2a8-654e-4ae4-b44e-17231c7f61f4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.180241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 218/438] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:32.183901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad2a8-654e-4ae4-b44e-17231c7f61f4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.199901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.200749 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.201034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.201308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.203234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.204661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.206272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 221/439] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:32.207024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.281619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fad2a8-654e-4ae4-b44e-17231c7f61f4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.301666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd22116-ee85-4852-b0e0-b9ccfd52a676 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.314707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334f874-c531-49b8-bc0a-e3cc91d6bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.315533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334f874-c531-49b8-bc0a-e3cc91d6bd01 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.315807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334f874-c531-49b8-bc0a-e3cc91d6bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.316084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334f874-c531-49b8-bc0a-e3cc91d6bd01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.325816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334f874-c531-49b8-bc0a-e3cc91d6bd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:32.333645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7334f874-c531-49b8-bc0a-e3cc91d6bd01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:32.334001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:32.335061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:32.335995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:32.336651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.336651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.336651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.336824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 219/440] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:32.336824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04aebbc-1855-42fc-9df1-2a01481fe0f5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.336824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04aebbc-1855-42fc-9df1-2a01481fe0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.336824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04aebbc-1855-42fc-9df1-2a01481fe0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.340777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.342213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.344029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 222/441] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:32.344786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.360556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d04aebbc-1855-42fc-9df1-2a01481fe0f5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:32.361744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d04aebbc-1855-42fc-9df1-2a01481fe0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:32.427051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 220/442] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:32.428054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04aebbc-1855-42fc-9df1-2a01481fe0f5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.439560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6343efc-61a7-423b-b88c-2d5f223845f4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.472349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.473000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.473277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.473557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.474391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=0e4b5422852e4a658bdd2ef28748da83) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:32.474700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.476171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.481780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 223/443] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=0e4b5422852e4a658bdd2ef28748da83&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:32.482551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.530386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04aebbc-1855-42fc-9df1-2a01481fe0f5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.567931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.568538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.568824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.569105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.569889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:32.570202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.571671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.585833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 221/444] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:32.585833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.609673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a7c3-4a5e-49df-a89b-bead63be50bf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.649992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.650715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.651001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.651344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.652204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=caa01d8eaed74e7a886bc75acdaff590, scope.project.id=f6fe6e0792f3432ab55581cdd4965083) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:32.652655 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.654042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.667762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 224/445] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=caa01d8eaed74e7a886bc75acdaff590 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:32.668311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.696154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a1a68-2eab-4ca4-89d4-6de9964a1176 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.748221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.749049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.749421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.749708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.769040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:32.777667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:32.779576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:32.780394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 222/446] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:32.788396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:32.803990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a3d308-688b-4aca-b7fd-17d4241e95ea None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.842354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.843112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.843485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.843777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.905582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a34eed0-49f0-4bcc-8beb-7187921f3208 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:32.925476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.926996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.944909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:32.945586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:32.945891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:32.946146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:32.946894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:32.947226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:32.948617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:32.957838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 223/447] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:32.963536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:33.045946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 225/448] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:33.051705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:33.077272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549c86-0be9-47f9-8db2-62b4d653cbac None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:33.120263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:33.121606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:33.121606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:33.121606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:33.155991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee003-6ed7-4d73-b279-577c987d0e70 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:33.188431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:33.188605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:33.189281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:33.189563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:33.189898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] PATH_INFO: `/v3/projects/f6fe6e0792f3432ab55581cdd4965083` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:33.190025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:33.191073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] RBAC: Authorizing `identity:get_project(project_id=f6fe6e0792f3432ab55581cdd4965083)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:33.192508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:33.194188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 226/449] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:33 2022] GET /identity/v3/projects/f6fe6e0792f3432ab55581cdd4965083 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:33.199500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:33.284398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 224/450] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:33.289862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:33.291536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a297ed64-0b26-4ea6-bce1-15f031b8f244 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:33.323787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:33.324626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:33.324904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:33.325171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] PATH_INFO: `/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:33.326332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] RBAC: Authorizing `identity:get_group(group_id=dbb330a9947544dfaa9c0b0e0834fa99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:33.327979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:33.329568 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 227/451] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:33 2022] GET /identity/v3/groups/dbb330a9947544dfaa9c0b0e0834fa99 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:33.335083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:33.384586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a99b52-90ca-4f25-b252-8cc28731c6c6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:33.417058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:33.417905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:33.418187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:33.418462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] PATH_INFO: `/v3/projects/0505b6fc7edf412485d1ca7159b626ae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:33.419679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] RBAC: Authorizing `identity:get_project(project_id=0505b6fc7edf412485d1ca7159b626ae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:33.421449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:33.423142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 225/452] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:50:33 2022] GET /identity/v3/projects/0505b6fc7edf412485d1ca7159b626ae => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:33.428537 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:33.428981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4682533-fd7c-412d-a573-44dd636c1262 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:33.461302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:33.461945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:33.462217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:33.462488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:33.463342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] RBAC: Adding query filter params (group.id=dbb330a9947544dfaa9c0b0e0834fa99, role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=f6fe6e0792f3432ab55581cdd4965083) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:33.463651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:33.465053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:33.471363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 228/453] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:33 2022] GET /identity/v3/role_assignments?group.id=dbb330a9947544dfaa9c0b0e0834fa99&scope.project.id=f6fe6e0792f3432ab55581cdd4965083&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:33.527341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f5c96-b71c-4ba7-9600-2e2a40836c80 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:33.564566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bcb23-f072-472e-940c-ebcead3f3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:33.565427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bcb23-f072-472e-940c-ebcead3f3c46 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:33.565713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bcb23-f072-472e-940c-ebcead3f3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:33.565990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bcb23-f072-472e-940c-ebcead3f3c46 None admin] PATH_INFO: `/v3/groups/1564d271d01243ec8d7c47f349dac37e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:33.567284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bcb23-f072-472e-940c-ebcead3f3c46 None admin] RBAC: Authorizing `identity:get_group(group_id=1564d271d01243ec8d7c47f349dac37e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:33.568758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bcb23-f072-472e-940c-ebcead3f3c46 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:33.570470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 226/454] 10.222.0.49 () {56 vars in 1180 bytes} [Tue May 10 20:50:33 2022] GET /identity/v3/groups/1564d271d01243ec8d7c47f349dac37e => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:33.576343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:33.681051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a33272-573a-4253-8d3d-afb60795273e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:33.714361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f8145-8638-44d7-b663-cb896fc5ed4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:33.716087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f8145-8638-44d7-b663-cb896fc5ed4a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:33.716087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f8145-8638-44d7-b663-cb896fc5ed4a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:33.716087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f8145-8638-44d7-b663-cb896fc5ed4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:33.716415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f8145-8638-44d7-b663-cb896fc5ed4a None admin] RBAC: Adding query filter params (group.id=1564d271d01243ec8d7c47f349dac37e, role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=0505b6fc7edf412485d1ca7159b626ae) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:33.716724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f8145-8638-44d7-b663-cb896fc5ed4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:33.718729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f8145-8638-44d7-b663-cb896fc5ed4a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:33.724615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 229/455] 10.222.0.49 () {56 vars in 1376 bytes} [Tue May 10 20:50:33 2022] GET /identity/v3/role_assignments?group.id=1564d271d01243ec8d7c47f349dac37e&scope.project.id=0505b6fc7edf412485d1ca7159b626ae&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:36.356074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1faa73-7c81-4088-ae93-61ca911aeaf9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:36.356711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1faa73-7c81-4088-ae93-61ca911aeaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:36.356711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1faa73-7c81-4088-ae93-61ca911aeaf9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:36.358343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 227/456] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:36.365444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467144-ae00-4ecb-b427-99a7f91c8849 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:36.366436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467144-ae00-4ecb-b427-99a7f91c8849 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:36.366922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42467144-ae00-4ecb-b427-99a7f91c8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:36.392164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-42467144-ae00-4ecb-b427-99a7f91c8849 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:36.393727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-42467144-ae00-4ecb-b427-99a7f91c8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:36.492231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 230/457] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:36.537956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1faa73-7c81-4088-ae93-61ca911aeaf9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:36.557325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cb9db-567b-4cec-9bcb-5225a5cc57af None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:36.558044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cb9db-567b-4cec-9bcb-5225a5cc57af None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:36.558532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cb9db-567b-4cec-9bcb-5225a5cc57af None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:36.560155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 231/458] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:50:36.575012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134495c9-f3a0-4a4f-946b-669bb3568f3e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:36.575345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134495c9-f3a0-4a4f-946b-669bb3568f3e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:36.575606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134495c9-f3a0-4a4f-946b-669bb3568f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:36.604179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-134495c9-f3a0-4a4f-946b-669bb3568f3e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:36.605887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-134495c9-f3a0-4a4f-946b-669bb3568f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:36.676145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1faa73-7c81-4088-ae93-61ca911aeaf9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:36.741082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:36.741316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 232/459] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:36.747183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:36.747747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:36.748230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:36.771578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:36.773348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:36.791053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134495c9-f3a0-4a4f-946b-669bb3568f3e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:36.806475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:36.807515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:36.808565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:36.808565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:36.808565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:36.808565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:36.810940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 228/460] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:36.824180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:36.954738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408eae-a702-4bbd-ba50-4e2a0c748915 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:36.997111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134495c9-f3a0-4a4f-946b-669bb3568f3e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:37.009827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0243da-7022-4387-a123-e1ba46919c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.010719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0243da-7022-4387-a123-e1ba46919c01 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.011172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0243da-7022-4387-a123-e1ba46919c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.011590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0243da-7022-4387-a123-e1ba46919c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.012459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0243da-7022-4387-a123-e1ba46919c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:37.012933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0243da-7022-4387-a123-e1ba46919c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.014473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0243da-7022-4387-a123-e1ba46919c01 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.027638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 229/461] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:37.029237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7877-e2e6-425b-b364-d7cbbae03f2c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.029705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7877-e2e6-425b-b364-d7cbbae03f2c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.030194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c7877-e2e6-425b-b364-d7cbbae03f2c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.033082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 230/462] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:37.033989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c7877-e2e6-425b-b364-d7cbbae03f2c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.057918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf138d1-6f2a-4958-8866-c3ef9ef782ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.059162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf138d1-6f2a-4958-8866-c3ef9ef782ad None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.059540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf138d1-6f2a-4958-8866-c3ef9ef782ad None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.059886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf138d1-6f2a-4958-8866-c3ef9ef782ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.073267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf138d1-6f2a-4958-8866-c3ef9ef782ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.074865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf138d1-6f2a-4958-8866-c3ef9ef782ad None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ebf138d1-6f2a-4958-8866-c3ef9ef782ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:37.097617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:37.098525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:37.099447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:37.099447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:37.099447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:37.099447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:37.103201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 233/463] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:37.104669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd5ee-89c8-410a-a793-8bd35fa7e324 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.104959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd5ee-89c8-410a-a793-8bd35fa7e324 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.105242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bdd5ee-89c8-410a-a793-8bd35fa7e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.127435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-66bdd5ee-89c8-410a-a793-8bd35fa7e324 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:37.129436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-66bdd5ee-89c8-410a-a793-8bd35fa7e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:37.155283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c7877-e2e6-425b-b364-d7cbbae03f2c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:37.192853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b3a9f-821e-4b5b-b73a-247dcac97f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.193525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3a9f-821e-4b5b-b73a-247dcac97f3f None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.193803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3a9f-821e-4b5b-b73a-247dcac97f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.194077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b3a9f-821e-4b5b-b73a-247dcac97f3f None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.194780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b3a9f-821e-4b5b-b73a-247dcac97f3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.196250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b3a9f-821e-4b5b-b73a-247dcac97f3f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.205003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 234/464] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:37.205606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd5ee-89c8-410a-a793-8bd35fa7e324 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.276781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 231/465] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:37 2022] POST /identity/v3/users => generated 246 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:37.278409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1e4d-d918-4d1e-b6c3-098e6199427b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.278902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1e4d-d918-4d1e-b6c3-098e6199427b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.279277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1e4d-d918-4d1e-b6c3-098e6199427b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.283176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 232/466] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:37.283176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f1e4d-d918-4d1e-b6c3-098e6199427b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.322614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bdd5ee-89c8-410a-a793-8bd35fa7e324 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:37.370260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ffcbce-31d8-41d9-b29f-806d304f9437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.371104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffcbce-31d8-41d9-b29f-806d304f9437 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.371528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffcbce-31d8-41d9-b29f-806d304f9437 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.372004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ffcbce-31d8-41d9-b29f-806d304f9437 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.372807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffcbce-31d8-41d9-b29f-806d304f9437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:37.373224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffcbce-31d8-41d9-b29f-806d304f9437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.374845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ffcbce-31d8-41d9-b29f-806d304f9437 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.388398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 235/467] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:37.390396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e726202-64b7-40c3-b010-9a04efed3fad None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.390782 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e726202-64b7-40c3-b010-9a04efed3fad None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.391073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e726202-64b7-40c3-b010-9a04efed3fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.408886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8e726202-64b7-40c3-b010-9a04efed3fad None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:37.409786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f1e4d-d918-4d1e-b6c3-098e6199427b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:37.410276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8e726202-64b7-40c3-b010-9a04efed3fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:37.447961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.449123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.449612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.450061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.463248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.465112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:37.484146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:37.485221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:37.486088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:37.486088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:37.486088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:37.486088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:37.487905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 233/468] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:37.488919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.491112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 236/469] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:37.494163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e726202-64b7-40c3-b010-9a04efed3fad None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.605435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e726202-64b7-40c3-b010-9a04efed3fad None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:37.613211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173dca0-119f-4036-9f34-a274599a5b6a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:37.651767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.652527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.652829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.653105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.653950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:37.654256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.655046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.656533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.656710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.657174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.657641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.658773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.661019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.668684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 237/470] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:37.669720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.759382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 234/471] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:37 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:37.760711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.809143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabccd3a-e2ce-4354-a4c5-facaee258849 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:37.889717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:37.891237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:37.891751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:37.893492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:37.913111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:37.917472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:37.955147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:37.956068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:37.956922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:37.956922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:37.956922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:37.956922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:37.956922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 238/472] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:37.960507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:37.994755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550b4ef-4963-4590-bf81-2a90b131851b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:38.033242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29e0d7-d78c-453f-a922-a703d7210df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:38.033856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29e0d7-d78c-453f-a922-a703d7210df3 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.034143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29e0d7-d78c-453f-a922-a703d7210df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.034424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29e0d7-d78c-453f-a922-a703d7210df3 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.035219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29e0d7-d78c-453f-a922-a703d7210df3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:38.036628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29e0d7-d78c-453f-a922-a703d7210df3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:38.079028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8efc3-5177-42d3-8ede-280dee74e6ce None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:38.117292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f6d8b2-0983-4457-ab8c-3c2721256b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:38.117968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6d8b2-0983-4457-ab8c-3c2721256b5f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.118250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6d8b2-0983-4457-ab8c-3c2721256b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.118582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f6d8b2-0983-4457-ab8c-3c2721256b5f None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.119746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6d8b2-0983-4457-ab8c-3c2721256b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:38.119746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6d8b2-0983-4457-ab8c-3c2721256b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:38.121003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f6d8b2-0983-4457-ab8c-3c2721256b5f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:38.134454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 239/473] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:38.135887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256b547-3e65-416b-baca-36a07f63aca7 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.136228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256b547-3e65-416b-baca-36a07f63aca7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.136524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256b547-3e65-416b-baca-36a07f63aca7 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.137532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 235/474] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:37 2022] POST /identity/v3/users => generated 248 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:38.137951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 240/475] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:38.144059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc249fe-fd3b-4ea9-ab74-c5ab00a6e1e0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.144674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc249fe-fd3b-4ea9-ab74-c5ab00a6e1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.145153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc249fe-fd3b-4ea9-ab74-c5ab00a6e1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.149608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256b547-3e65-416b-baca-36a07f63aca7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:38.168827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2bc249fe-fd3b-4ea9-ab74-c5ab00a6e1e0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:38.173099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2bc249fe-fd3b-4ea9-ab74-c5ab00a6e1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:38.261455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 236/476] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:38.323948 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc249fe-fd3b-4ea9-ab74-c5ab00a6e1e0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:38.343725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256b547-3e65-416b-baca-36a07f63aca7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:38.378651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:38.379371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.379619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.379891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.380819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:38.382029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:38.440981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc249fe-fd3b-4ea9-ab74-c5ab00a6e1e0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:38.476419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:38.476625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 241/477] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:38 2022] POST /identity/v3/users => generated 249 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:50:38.477280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.477565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.477840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.478657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:38.480089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:38.518219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 20:50:38.518219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 20:50:38.518219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [parameters: {'id': '7c0a569666984aea8ff01d2565ad4834', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 20:50:38.518219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 10 20:50:38.536267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return ref.to_dict() May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:50:38.537211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 20:50:38.538141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 20:50:38.539812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:50:38.540950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:50:38.542017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'id': '7c0a569666984aea8ff01d2565ad4834', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:38.543709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 10 20:50:38.547850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:38.548770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 237/478] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 20:50:38 2022] POST /identity/v3/roles => generated 144 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:38.548846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:38.671662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e83ce-af44-4aec-9870-3debb04ffb05 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:38.709135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08140a-03e1-4f41-86b3-0e2dd980a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:38.710219 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08140a-03e1-4f41-86b3-0e2dd980a863 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.710657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08140a-03e1-4f41-86b3-0e2dd980a863 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.711170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08140a-03e1-4f41-86b3-0e2dd980a863 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.723448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08140a-03e1-4f41-86b3-0e2dd980a863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fc08140a-03e1-4f41-86b3-0e2dd980a863 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:38.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:38.733577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 10 20:50:38.734978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:38.737815 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 242/479] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:50:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:38.744108 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:38.861018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00f2e3-0f9c-43fb-b68b-f6fb8b8e9730 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:38.895565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66d4f7-d45c-485d-81a3-a9f5ecfd92df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:38.896245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d4f7-d45c-485d-81a3-a9f5ecfd92df None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:38.896575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d4f7-d45c-485d-81a3-a9f5ecfd92df None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:38.896863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66d4f7-d45c-485d-81a3-a9f5ecfd92df None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:38.897622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66d4f7-d45c-485d-81a3-a9f5ecfd92df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:38.897936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66d4f7-d45c-485d-81a3-a9f5ecfd92df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:38.899356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e66d4f7-d45c-485d-81a3-a9f5ecfd92df None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:38.908359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 238/480] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:39.859453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9de00-9e8d-49ee-b718-ce1e0e797c3e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:39.859453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9de00-9e8d-49ee-b718-ce1e0e797c3e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:39.860047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9de00-9e8d-49ee-b718-ce1e0e797c3e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:39.861542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 243/481] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:39.867318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b2e4a-caa5-4d17-af21-50008f98f695 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:39.867790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b2e4a-caa5-4d17-af21-50008f98f695 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:39.868088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b2e4a-caa5-4d17-af21-50008f98f695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:39.886020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-048b2e4a-caa5-4d17-af21-50008f98f695 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:39.887397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-048b2e4a-caa5-4d17-af21-50008f98f695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:39.958812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 239/482] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:39.982493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9de00-9e8d-49ee-b718-ce1e0e797c3e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:40.130522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9de00-9e8d-49ee-b718-ce1e0e797c3e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:40.182041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:40.182041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:40.182560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:40.182560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:40.204058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:40.211759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:40.213783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:40.215788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 244/483] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:40.228231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b2e4a-caa5-4d17-af21-50008f98f695 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:40.336405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b2e4a-caa5-4d17-af21-50008f98f695 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:40.371161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5cc178-5b00-4e29-86f8-e63c0e8c5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:40.371843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc178-5b00-4e29-86f8-e63c0e8c5bae None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:40.372128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc178-5b00-4e29-86f8-e63c0e8c5bae None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:40.372405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5cc178-5b00-4e29-86f8-e63c0e8c5bae None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:40.373158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cc178-5b00-4e29-86f8-e63c0e8c5bae None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:40.373465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cc178-5b00-4e29-86f8-e63c0e8c5bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:40.375034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5cc178-5b00-4e29-86f8-e63c0e8c5bae None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:40.383806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 240/484] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:40.389282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:40.391733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900352b-2013-4b7d-82a0-c5deb8a15758 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:40.392022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900352b-2013-4b7d-82a0-c5deb8a15758 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:40.392301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c900352b-2013-4b7d-82a0-c5deb8a15758 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:40.393817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 241/485] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:40.399960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab06c1-0e98-4a10-a0a7-ec1dbf32965b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:40.400596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab06c1-0e98-4a10-a0a7-ec1dbf32965b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:40.401082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab06c1-0e98-4a10-a0a7-ec1dbf32965b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:40.419080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-92ab06c1-0e98-4a10-a0a7-ec1dbf32965b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:40.420910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-92ab06c1-0e98-4a10-a0a7-ec1dbf32965b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:40.543226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 242/486] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:50:40.586997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b1ba6-a3df-4bdc-b7d2-e257e455ddf0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:40.591572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab06c1-0e98-4a10-a0a7-ec1dbf32965b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:40.650782 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:40.651941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:40.653324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:40.654433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:40.679075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:40.680986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:40.712266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:40.719491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:40.720372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:40.720372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:40.720372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:40.720372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:40.720372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 245/487] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:40.736168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:40.759976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab06c1-0e98-4a10-a0a7-ec1dbf32965b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:40.853882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:40.854983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:40.855467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:40.856270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:40.867771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:40.876779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:40.877668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:40.878593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:40.885659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 243/488] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:40.887044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:40.930968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7d14-f1a1-4ab0-a33f-862d49f9c1ff None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:40.991671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70588d3-5827-4956-9e8b-db575d9caf3b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.028306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.029289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.030198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.031697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.032182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.032695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.033781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.034266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.034762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:41.035968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.036931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:41.037437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.038723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.041658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.063653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 244/489] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:41.068519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.076316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 246/490] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:41.092732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.245245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ca917-9f4d-4408-9f51-4c5a14d9eaca None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.278504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84fd3d-0f1f-4d50-9d17-8fc4ccc1c688 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.280848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2342f4-f4cc-4e6c-95da-1259c55b2bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.281711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2342f4-f4cc-4e6c-95da-1259c55b2bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.281990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2342f4-f4cc-4e6c-95da-1259c55b2bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.282266 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2342f4-f4cc-4e6c-95da-1259c55b2bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.292882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2342f4-f4cc-4e6c-95da-1259c55b2bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.294339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2342f4-f4cc-4e6c-95da-1259c55b2bc4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4e2342f4-f4cc-4e6c-95da-1259c55b2bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:41.312984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:41.313887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:41.315385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:41.315385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:41.315385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:41.315385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:41.315385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 245/491] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:41.315816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c51b17-0552-45cc-865e-9a6c32426047 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.316104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c51b17-0552-45cc-865e-9a6c32426047 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.316378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c51b17-0552-45cc-865e-9a6c32426047 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.318080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80f724-05e3-49b6-ada4-6b2aaf40e2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.319546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f724-05e3-49b6-ada4-6b2aaf40e2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.320025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f724-05e3-49b6-ada4-6b2aaf40e2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.320489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80f724-05e3-49b6-ada4-6b2aaf40e2a0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.321654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 246/492] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:41.322419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c51b17-0552-45cc-865e-9a6c32426047 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.329694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f724-05e3-49b6-ada4-6b2aaf40e2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.331551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80f724-05e3-49b6-ada4-6b2aaf40e2a0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-2c80f724-05e3-49b6-ada4-6b2aaf40e2a0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:41.348422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:41.349430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:50:41.350338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:41.353204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 247/493] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:41.354974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a99fc-0f1c-4395-a859-3c904733c8a2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.355572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a99fc-0f1c-4395-a859-3c904733c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.356061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a99fc-0f1c-4395-a859-3c904733c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.376921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0a1a99fc-0f1c-4395-a859-3c904733c8a2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:41.378899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0a1a99fc-0f1c-4395-a859-3c904733c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:41.431015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c51b17-0552-45cc-865e-9a6c32426047 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.465422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 248/494] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:41.465776 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.466375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.467046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a99fc-0f1c-4395-a859-3c904733c8a2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.471786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.471786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.472483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:41.472796 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.474193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.501915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 247/495] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:41.506000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.579952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a99fc-0f1c-4395-a859-3c904733c8a2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.615602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6350b3-cf2f-41cd-809a-d5add9b5e3ed None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.618922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.619624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.619906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.620178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.621024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:41.621324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.622751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.648230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f925-e854-4730-b301-298e09b9c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.649021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f925-e854-4730-b301-298e09b9c27e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.649305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f925-e854-4730-b301-298e09b9c27e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.649582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f925-e854-4730-b301-298e09b9c27e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.660317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f925-e854-4730-b301-298e09b9c27e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:41.660789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 249/496] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:41.661888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1e83f925-e854-4730-b301-298e09b9c27e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:41.668272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:41.669183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:41.670513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 248/497] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:41.671562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b23e-c033-4618-a61f-10696176052f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.671562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b23e-c033-4618-a61f-10696176052f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.671754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19b23e-c033-4618-a61f-10696176052f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.676853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 249/498] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:41.677674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19b23e-c033-4618-a61f-10696176052f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.803859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30bcdd-bca1-49b1-a415-770e018305cb None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.804044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19b23e-c033-4618-a61f-10696176052f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.835728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f376a3b-38c5-4b4c-9cf6-8871369b5b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.836361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376a3b-38c5-4b4c-9cf6-8871369b5b5d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.836518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.836627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376a3b-38c5-4b4c-9cf6-8871369b5b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.836901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f376a3b-38c5-4b4c-9cf6-8871369b5b5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.837306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.837590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.837868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.846325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.847822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:41.862331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:41.863462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:41.864414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 250/499] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:41.864983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:41.903793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f376a3b-38c5-4b4c-9cf6-8871369b5b5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:41.905257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f376a3b-38c5-4b4c-9cf6-8871369b5b5d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:41.962884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfead2f6-6c1a-4e9e-8720-ae71f6536e8d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:41.995883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f389a-8efe-4115-962b-c6d74eb5e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:41.996539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f389a-8efe-4115-962b-c6d74eb5e694 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:41.996823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f389a-8efe-4115-962b-c6d74eb5e694 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:41.997100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f389a-8efe-4115-962b-c6d74eb5e694 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:41.997845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f389a-8efe-4115-962b-c6d74eb5e694 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:41.998149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f389a-8efe-4115-962b-c6d74eb5e694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.003849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 250/500] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:42.003990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f389a-8efe-4115-962b-c6d74eb5e694 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.004068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef67e1-b3cb-4992-88cb-2753eff7120f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.004068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef67e1-b3cb-4992-88cb-2753eff7120f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.004068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef67e1-b3cb-4992-88cb-2753eff7120f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.007959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 251/501] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:42.009218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629ad99-a9c2-4709-960d-95b5a759d4fa None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.009505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629ad99-a9c2-4709-960d-95b5a759d4fa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.009781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629ad99-a9c2-4709-960d-95b5a759d4fa None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.013665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 252/502] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:42.013665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629ad99-a9c2-4709-960d-95b5a759d4fa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.020382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-76ef67e1-b3cb-4992-88cb-2753eff7120f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:42.021569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-76ef67e1-b3cb-4992-88cb-2753eff7120f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:42.084929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 251/503] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:42.085678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef67e1-b3cb-4992-88cb-2753eff7120f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.114729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6629ad99-a9c2-4709-960d-95b5a759d4fa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.146615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.147318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.147607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.147885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.148723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:42.149032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.150476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.167739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 253/504] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:42.168560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.181572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef67e1-b3cb-4992-88cb-2753eff7120f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.213837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90e4fa-0f3a-4d7b-b13d-06419c4019e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.214624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e4fa-0f3a-4d7b-b13d-06419c4019e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.214910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e4fa-0f3a-4d7b-b13d-06419c4019e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.215228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90e4fa-0f3a-4d7b-b13d-06419c4019e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.225650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90e4fa-0f3a-4d7b-b13d-06419c4019e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.227152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90e4fa-0f3a-4d7b-b13d-06419c4019e6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1a90e4fa-0f3a-4d7b-b13d-06419c4019e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:42.244097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:42.245142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:42.246046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:42.246046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:42.246046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:42.246046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:42.246046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 252/505] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:42.246493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be9988-d2ac-4efd-9772-25655a6f00d5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.246783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be9988-d2ac-4efd-9772-25655a6f00d5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.247058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be9988-d2ac-4efd-9772-25655a6f00d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.263262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f4be9988-d2ac-4efd-9772-25655a6f00d5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:42.264340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2007ace-b14a-4a39-9a77-3f5ea1356809 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.264445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f4be9988-d2ac-4efd-9772-25655a6f00d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:42.298412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.299230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.299518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.299797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.309444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.310894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.328090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 253/506] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:42.328673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:42.329482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:42.330365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:42.330365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:42.330365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:42.330365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:42.330574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be9988-d2ac-4efd-9772-25655a6f00d5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.330650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 254/507] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:42.330650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.426257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be9988-d2ac-4efd-9772-25655a6f00d5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.426574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98444d-a849-48b5-8591-3e72c4c7ce3d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.458486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.458683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.459144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.459404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.459492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.459685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.459786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.459958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.470365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:42.477973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:42.478861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 254/508] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:42.479918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.528128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.529577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.572998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f185c308-0d07-45e8-bc50-ddb464d216e6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.608935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.609607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.609894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.610170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.610898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:42.611236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.612632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.624216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 255/509] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:42.624727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 255/510] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:42.625017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.625756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.719724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291964f3-f298-4a1a-940b-056fd9b6f81d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.724406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a35e5-a360-4944-b5a2-610d9e967715 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.753364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.754023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.754302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.754576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.755325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:42.755633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.757097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.758708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.759531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.759816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.760092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.768226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 256/511] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:42.769025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.770146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.771637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:42.789314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:42.790265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:42.791144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:42.791144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:42.791144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:42.791144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:42.791144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 256/512] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:42.791615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.868979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5c1ed-8962-4b03-8b2e-c5617d651cd7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.888201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb598d0-364e-4021-8149-60c03547f986 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:42.900205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.900859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.901139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.901409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.902151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:42.902451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.903846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.912031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 257/513] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:42.912802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:42.922598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:42.923410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:42.923747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:42.924027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:42.930535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:42.932002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:42.946441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:42.947324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:42.948176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 257/514] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:42.949214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.008597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dffdc0-5348-4b9f-bfce-4721d80257b7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.040932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.041715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.041997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.042268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.043677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d214576-b6d5-47f7-9493-2e092e497388 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.053607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.055066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:43.071451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:43.072410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:43.073304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:43.073304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:43.073304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:43.073304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:43.073304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 258/515] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:43.073578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.080413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.081211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.081497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.081776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.089335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.090790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:43.104954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:43.106013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 258/516] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:43.107410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.175813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef3eb5-5a4b-4240-b559-4132324da635 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.200409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e88b5-e868-40ba-a91b-c2c6f13e95f0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.208503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.209162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.209446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.209723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.210440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:43.210749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.212156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.223674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 259/517] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:43.223674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.239408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.240202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.240485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.240761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.251686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.253130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:43.269529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:43.270463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:43.271400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:43.271400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:43.271400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:43.271400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:43.271400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 259/518] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:43.271749 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.327848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17f6f-25b1-4caa-afda-3b9b2bb9fc3b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.362158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.362817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.363104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.363412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.364205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:43.364516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.365859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e5b0e-4f28-464f-a513-0a00402fa72e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.365967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.383805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 260/519] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:43.384424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.398943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.399645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.399933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.400214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.400945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:43.401260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.402630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.413887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 260/520] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:43.414645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.480710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032f584-ef67-42d6-a9e1-ae2bf07e09c9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.513249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.513528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9a801-ed10-4e4a-83b3-01c1030b7854 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.513909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.514186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.514456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.515580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:43.515891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.517332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.546894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.547533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.547819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.548095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.548798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.550222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.553074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 261/521] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:43.553885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.632895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 261/522] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:50:43 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:50:43.633064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.652026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae8b19-afd4-4059-b4db-b5ba460b74eb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.689568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.690253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.690537 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.690816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.691596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:43.691911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.693414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.706064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 262/523] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:43.707028 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.750721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec9339-2df0-46d7-85f8-6e896b9db8cd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.786611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.787465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.787768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.788045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.788912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=dd4bf9aaaae4483bade1570b1c1cfae7) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:43.789225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.790689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.797710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 262/524] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/role_assignments?user.id=dd4bf9aaaae4483bade1570b1c1cfae7&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:43.798824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.817654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d5f4ea-1a3a-4995-bae9-902aa89cd329 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.860078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.860078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.860393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.860644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:43.869533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:43.871050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:43.891549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:43.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:43.893414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 263/525] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:43.893888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:43.923801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d246-3039-40e6-8646-5859080dda1d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:43.962558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:43.963259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:43.963545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:43.963822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.004052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719adf1-8dfa-48ef-acce-ec7b437090d5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.037305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.038758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.039683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.040545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.040832 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.041112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.049569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.050969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:44.067149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:44.068095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:50:44.069020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:44.072899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 264/526] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:44.073737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.143247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 263/527] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:44.144124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.178660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0088b8-b7b2-4d94-830f-20a44621a0b1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.213804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.214474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.214758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.215068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.215874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:44.216185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.217700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.229780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 265/528] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:44.230698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.253137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a22d5-7831-449b-b0d3-48ad33c5c446 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.289067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.289749 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.290037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.290312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.291186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:44.291598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.293055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.322455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 264/529] 10.222.0.49 () {56 vars in 1139 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:44.322455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.351937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6eba5-08c4-4fe6-83af-e8a340013aec None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.386959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.388188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.388720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.389199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.400438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.402216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:44.421478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:44.422362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:44.423430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:44.423430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:44.423430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:44.423430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:44.425694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 266/530] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:44.426907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.433446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91ebce-6316-4f50-aeb0-19d17923eb85 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.469249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.470275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.470774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.471280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.472364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=69f37dda98124a8c8cf4406d985933f4) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:44.472933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.474579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.480938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 265/531] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/role_assignments?user.id=69f37dda98124a8c8cf4406d985933f4&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:44.482128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.553810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16319ac8-efb5-4d0d-90eb-268c253444d3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.592008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e91ab-8ef9-4886-b1f0-5f81a40211ee None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.609806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.610477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.610764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.611043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.657358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.658440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.658932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.659445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.660388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:44.660891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.662536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.677452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 266/532] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:44.683425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.753660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.755749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.818561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bfa5b-929a-470d-af8d-eca2fa4055c3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:44.868898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:44.869611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:44.869897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:44.870180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:44.884624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:44.884990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 267/533] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:44.885652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:44.886722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:44.914024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:44.914946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:44.915863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:44.923604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 267/534] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:44.931523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:45.036255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd035a1-fce1-4457-8fce-2fc75bdee27d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:45.058027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf083-6e14-4f3d-942b-14b0bde1e14b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:45.072294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:45.073281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:45.073776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:45.074251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:45.075264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:45.075789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:45.077672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:45.096832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 268/535] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:45.106566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:45.112752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:45.112752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:45.112752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:45.112752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:45.131226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:45.131226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:45.161343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:45.162261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:45.163350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:45.163350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:45.163350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:45.163350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:45.163350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 268/536] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:45.169090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:45.270985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d9631-cf51-49a3-a354-a9aed60c929e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:45.291094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f9e045-be9b-4da9-b95a-a85fa655085e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:45.306353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:45.307302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:45.307763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:45.308212 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:45.309128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:45.309623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:45.311200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:45.328647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 269/537] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:45.330100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:45.335518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:45.336190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:45.336477 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:45.336759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:45.337606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=8f2ddd09bc4743f585cda702c3047e3f) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:45.337921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:45.339384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:45.350546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 269/538] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:45 2022] GET /identity/v3/role_assignments?user.id=8f2ddd09bc4743f585cda702c3047e3f&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:45.439695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4d48b-51f5-4e75-9b90-d07c4a150e84 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:45.476980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:45.478110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:45.478568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:45.479010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:45.487054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:45.488747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:45.504234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:45.505157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:45.506030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:45.512480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 270/539] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:45.514029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:45.642083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e46df7-43cb-41fc-806a-c418a34c074f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:45.680079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f8cee-9927-4c9d-9bdc-20c586df0a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:45.680751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f8cee-9927-4c9d-9bdc-20c586df0a1b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:45.681036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f8cee-9927-4c9d-9bdc-20c586df0a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:45.681311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f8cee-9927-4c9d-9bdc-20c586df0a1b None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:45.682111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f8cee-9927-4c9d-9bdc-20c586df0a1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:45.682419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f8cee-9927-4c9d-9bdc-20c586df0a1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:45.683880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f8cee-9927-4c9d-9bdc-20c586df0a1b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:45.697017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 270/540] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:45.703798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:45.838553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde028a-c81a-45f4-8265-5cb8966512ce None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:45.874621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab25d3-0ec9-4ce3-9b33-1c824cc30d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:45.875683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab25d3-0ec9-4ce3-9b33-1c824cc30d1c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:45.876116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab25d3-0ec9-4ce3-9b33-1c824cc30d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:45.876532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab25d3-0ec9-4ce3-9b33-1c824cc30d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:45.877524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab25d3-0ec9-4ce3-9b33-1c824cc30d1c None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=c298cfd105174cd89ba5ef6eb50b1601) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:45.877976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab25d3-0ec9-4ce3-9b33-1c824cc30d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:45.879589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab25d3-0ec9-4ce3-9b33-1c824cc30d1c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:45.891263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 271/541] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:45 2022] GET /identity/v3/role_assignments?user.id=c298cfd105174cd89ba5ef6eb50b1601&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:46.388657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5877-b472-48cf-9414-60cc9db639da None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:46.389178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5877-b472-48cf-9414-60cc9db639da None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:46.389253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5877-b472-48cf-9414-60cc9db639da None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:46.391491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 271/542] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:46.396805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e07e1-6ab2-4fdb-86bb-5b20963b7979 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:46.397611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e07e1-6ab2-4fdb-86bb-5b20963b7979 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:46.398064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e07e1-6ab2-4fdb-86bb-5b20963b7979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:46.420756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-412e07e1-6ab2-4fdb-86bb-5b20963b7979 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:46.423035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-412e07e1-6ab2-4fdb-86bb-5b20963b7979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:46.481067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0de0f-d9f5-4f3f-9ff6-3490a0553935 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:46.481355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0de0f-d9f5-4f3f-9ff6-3490a0553935 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:46.481640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0de0f-d9f5-4f3f-9ff6-3490a0553935 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:46.483330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 272/543] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:50:46.490167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d39e39-9a30-4886-81d7-d59d750d840c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:46.490537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d39e39-9a30-4886-81d7-d59d750d840c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:46.491058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d39e39-9a30-4886-81d7-d59d750d840c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:46.505114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 272/544] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:46.537295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b2d39e39-9a30-4886-81d7-d59d750d840c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:46.537599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e07e1-6ab2-4fdb-86bb-5b20963b7979 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:46.538543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b2d39e39-9a30-4886-81d7-d59d750d840c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:46.673603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 273/545] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:46.699598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d39e39-9a30-4886-81d7-d59d750d840c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:46.745997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e07e1-6ab2-4fdb-86bb-5b20963b7979 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:46.825968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d39e39-9a30-4886-81d7-d59d750d840c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:46.836075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:46.837137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:46.837427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:46.837920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:46.862218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:46.862858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:46.863684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:46.863965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:46.864238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:46.875842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:46.880204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:46.881241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:46.882470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 273/546] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:46.885584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:46.887835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 274/547] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:46.891999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:46.893892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:46.999192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d0aba-7dba-4c94-b9b7-f3d2a1e4b6ba None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.026463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1728d-8a66-45b5-85d4-636a5b255ac3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.035566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.036333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.036615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.036892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.037660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:47.037965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.039389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.049514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 275/548] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:47.055048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.080677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.081366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.081655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.081936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.082699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:47.083007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.084420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.103937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 274/549] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:47.110100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.213921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f2a23-016f-4f71-8c01-e71255b64108 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.284031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.284760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.285047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.285325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.287672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165abbd-630c-4053-8c64-20caaa155ee4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.307618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.309093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:47.338282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:47.340472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:47.342511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:47.342511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:47.342511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:47.342511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:47.342511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 276/550] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:47.348246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.356129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.356927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.357210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.357485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.375332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.377918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:47.406468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:47.408971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:47.410973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:47.410973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:47.410973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:47.410973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:47.415141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 275/551] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:47.420030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.497609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff046d2-5cec-481a-91fc-678f0bde0bda None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.533003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1514d28-a7d8-4e34-a920-3f9319ef555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.534672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514d28-a7d8-4e34-a920-3f9319ef555c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.535437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514d28-a7d8-4e34-a920-3f9319ef555c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.536036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1514d28-a7d8-4e34-a920-3f9319ef555c None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.537412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1514d28-a7d8-4e34-a920-3f9319ef555c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:47.538015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1514d28-a7d8-4e34-a920-3f9319ef555c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.540041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1514d28-a7d8-4e34-a920-3f9319ef555c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.542339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cd3a6-28e0-4d49-a864-4e04a24bc4ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.556119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 277/552] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:47.558453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c761e-e10d-4d2e-9872-1ed732ed83e5 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.558925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c761e-e10d-4d2e-9872-1ed732ed83e5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.559420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c761e-e10d-4d2e-9872-1ed732ed83e5 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.566531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 278/553] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:47.567930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c761e-e10d-4d2e-9872-1ed732ed83e5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.581591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817f0b9-a8bc-4910-833c-6527afbb040d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.582418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f0b9-a8bc-4910-833c-6527afbb040d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.582777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f0b9-a8bc-4910-833c-6527afbb040d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.583196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817f0b9-a8bc-4910-833c-6527afbb040d None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.584105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817f0b9-a8bc-4910-833c-6527afbb040d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:47.584463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817f0b9-a8bc-4910-833c-6527afbb040d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.586001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817f0b9-a8bc-4910-833c-6527afbb040d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.601056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 276/554] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:47.601056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f548f-e76f-4c8d-851e-2c89c6b96d67 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.601308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f548f-e76f-4c8d-851e-2c89c6b96d67 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.605871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f548f-e76f-4c8d-851e-2c89c6b96d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.623082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-933f548f-e76f-4c8d-851e-2c89c6b96d67 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:47.625063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-933f548f-e76f-4c8d-851e-2c89c6b96d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:47.699390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 277/555] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:47.700395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f548f-e76f-4c8d-851e-2c89c6b96d67 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.705621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c761e-e10d-4d2e-9872-1ed732ed83e5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.746328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.747523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.748110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.748534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.757491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.761838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:47.775558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:47.776686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:50:47.777802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:47.779953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 279/556] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:47.781104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.839980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f548f-e76f-4c8d-851e-2c89c6b96d67 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.877696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.878502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.878963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.879351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.887036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:47.887955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0a6e0-a490-486b-a27f-db0185fa339d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:47.888752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:47.904704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:47.905810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:47.907007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 278/557] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:47.911579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:47.932298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:47.933414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:47.933871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:47.934730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:47.948739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:47.958530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:47.959454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:47.960242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:47.963034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 280/558] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:47.964051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.037425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c8b8d6-bda9-4d62-8ef9-5237e7ab40ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.078497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7957a7-d310-4424-82fc-88fafe2e6802 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.082390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.083257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.083681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.084097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.085079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:48.085546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.087599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.111785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 279/559] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:48.113071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.114857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.115950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.116468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.116732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.118231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:48.118231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.119674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.143284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 281/560] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:50:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:48.144337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.225313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b41c68-c072-4c59-8d57-e6c48caaee90 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.255829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bcaab-e3aa-4c4c-ad9d-4b58b6694301 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.259058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.259801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.260088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.260365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.261119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:48.261432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.262834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.275225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 280/561] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:48.275225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.295873 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.297220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.297507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.297781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.369531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.371266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.375138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9506689-2c52-4a19-ace4-b011a1ae1d5b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.408614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c30abb-34e2-4819-9c05-66ed1d23d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.409418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30abb-34e2-4819-9c05-66ed1d23d08e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.409679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30abb-34e2-4819-9c05-66ed1d23d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.409951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c30abb-34e2-4819-9c05-66ed1d23d08e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.420745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c30abb-34e2-4819-9c05-66ed1d23d08e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.422870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c30abb-34e2-4819-9c05-66ed1d23d08e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-85c30abb-34e2-4819-9c05-66ed1d23d08e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:48.439975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:48.440899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:48.441773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:48.441773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:48.441773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:48.441773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:48.441773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 281/562] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:48.442602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbef9-0225-4df1-a90b-93252084a4e6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.442701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbef9-0225-4df1-a90b-93252084a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.443149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fbef9-0225-4df1-a90b-93252084a4e6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.448574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 282/563] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:48.448574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbef9-0225-4df1-a90b-93252084a4e6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.481581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 282/564] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:48.481581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.550076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fbef9-0225-4df1-a90b-93252084a4e6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.573224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3a27f-be5b-4a14-baa9-f7fb44be4382 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.582860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5615754-ca63-46c3-bec3-19f65e92f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.583728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615754-ca63-46c3-bec3-19f65e92f0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.584011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615754-ca63-46c3-bec3-19f65e92f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.584287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5615754-ca63-46c3-bec3-19f65e92f0a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.595677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615754-ca63-46c3-bec3-19f65e92f0a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.597131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5615754-ca63-46c3-bec3-19f65e92f0a6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.607858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.608669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.609471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.609753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.610488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:48.610797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.612212 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d5615754-ca63-46c3-bec3-19f65e92f0a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:48.614198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:48.615105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:48.616050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:48.616050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:48.616050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:48.616050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:48.616050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 283/565] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:48.616766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3fc93-80d3-4a62-9820-d537e4cbca9b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.616936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3fc93-80d3-4a62-9820-d537e4cbca9b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.617196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3fc93-80d3-4a62-9820-d537e4cbca9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.623733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 283/566] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:48.626047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.633965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-36a3fc93-80d3-4a62-9820-d537e4cbca9b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:48.635182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36a3fc93-80d3-4a62-9820-d537e4cbca9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:48.699497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 284/567] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:48.700803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2b0e-c258-4211-9bc3-427fa416caeb None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.701090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2b0e-c258-4211-9bc3-427fa416caeb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.701367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada2b0e-c258-4211-9bc3-427fa416caeb None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.703388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 285/568] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:48.704076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada2b0e-c258-4211-9bc3-427fa416caeb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.728084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ed297-0980-4065-816f-b0ea1043ab57 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.760881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.761672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.761955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.762232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.773032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.774475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:48.791604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:48.792621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:48.793497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:48.793497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:48.793497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:48.793497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:48.793497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 284/569] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:48.793776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.836361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada2b0e-c258-4211-9bc3-427fa416caeb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.871260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5814e9-2fd9-4e2d-8565-02ead41efd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.871915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5814e9-2fd9-4e2d-8565-02ead41efd95 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.872195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5814e9-2fd9-4e2d-8565-02ead41efd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.872482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5814e9-2fd9-4e2d-8565-02ead41efd95 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.873197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5814e9-2fd9-4e2d-8565-02ead41efd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:48.873502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5814e9-2fd9-4e2d-8565-02ead41efd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.875603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5814e9-2fd9-4e2d-8565-02ead41efd95 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.886237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 286/570] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:48.887474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701440a-8564-4752-97a8-f1a1ed1a0973 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.887751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701440a-8564-4752-97a8-f1a1ed1a0973 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.888030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701440a-8564-4752-97a8-f1a1ed1a0973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.890807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7076df-3231-4229-a46d-f23acd339e93 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:48.903504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a701440a-8564-4752-97a8-f1a1ed1a0973 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:48.904693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a701440a-8564-4752-97a8-f1a1ed1a0973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:48.924103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:48.924898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:48.925182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:48.925458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:48.932057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:48.933501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:48.947260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:48.948318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 285/571] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:48.949680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:48.983539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 287/572] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:48.983539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701440a-8564-4752-97a8-f1a1ed1a0973 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.052268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf7d7b-7e14-483b-bd8d-362bbe1d22f4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.068241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701440a-8564-4752-97a8-f1a1ed1a0973 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.083592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.084381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.084654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.084920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.095264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:49.100262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.100910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.101189 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.101460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.102171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:49.102474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:49.102687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:49.103762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:49.104627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:49.105351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.105423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 286/573] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:49.105423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.116122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 288/574] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:49.116931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.204471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4438c8cf-d0ab-4a9e-9b17-6da8caf70413 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.213481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d775c7bc-5503-468f-9a49-4531a48d31d4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.236744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.237634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.237921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.238202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.245476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.245590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.246182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.246467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.246745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.246918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.247552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:49.247862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.249902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:49.261297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:49.262427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 287/575] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:49.263706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.266374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 289/576] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:49.267112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.357432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd98ce9-e5a3-425a-9e4b-34fc5661e9a7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.360394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3bcc6-93c5-4b6e-8d4f-20f30ae6d80a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.389432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.390801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.391080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.391384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.393377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.394038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.394322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.394600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.395378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:49.395696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.397077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.401106 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:49.404722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 290/577] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:49.406051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:49.410051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:49.411177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 288/578] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:49.412029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.500586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c316abb-0858-4b43-b414-520ce7be4293 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.508779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5603b3-a942-4c6f-885c-3f908021c4a1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.532062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.532849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.533134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.533413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.539379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.539919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.540245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.540524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.540793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/dd4bf9aaaae4483bade1570b1c1cfae7/roles/bd48cc77ef9847008cb25340f9c96405` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.541361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.555432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=dd4bf9aaaae4483bade1570b1c1cfae7, role_id=bd48cc77ef9847008cb25340f9c96405)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:49.556001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:49.557027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:49.563369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:49.563871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.563946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 291/579] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:49.563946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.653478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b77486-79b1-4b0e-8ccb-19d941ce48a5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.686775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.687555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.687842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.688120 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.688952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:49.689262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.690701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.707992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 292/580] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:49.708759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.801950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6160a-fd78-495a-91af-476635328932 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:49.834515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb090f-7185-434f-845a-166051da658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:49.835318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb090f-7185-434f-845a-166051da658c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:49.835596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb090f-7185-434f-845a-166051da658c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:49.835937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb090f-7185-434f-845a-166051da658c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:49.845627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb090f-7185-434f-845a-166051da658c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:49.847047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb090f-7185-434f-845a-166051da658c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-77cb090f-7185-434f-845a-166051da658c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:49.864027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:49.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:49.866112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:49.866112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:49.866112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:49.866112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:49.866112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 293/581] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:49.866431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb090f-7185-434f-845a-166051da658c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:49.900539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 289/582] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:49 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/dd4bf9aaaae4483bade1570b1c1cfae7/roles/bd48cc77ef9847008cb25340f9c96405 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:49.901426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.015567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb090f-7185-434f-845a-166051da658c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.049275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c3ac5b-a58a-42e4-b4ba-ac179eec20d2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.053381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.054341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.054842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.055406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.056401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:50.056939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.058464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.072584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 294/583] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:50.072584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.087915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.088892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.089393 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.089829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.090837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:50.091643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.092648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.104899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 290/584] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:50.105771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.181795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa47f4-dae9-48d8-a89e-24a94ca0dadb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.209956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf0296-7746-4427-ae43-3aa4bae56055 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.215506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.216291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.216575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.216843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.230221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.231805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.244367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.245026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.245306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.245577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.246294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:50.246596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.247970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:50.250182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:50.251093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:50.252114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:50.252114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:50.252114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:50.252114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:50.252114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 295/585] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:50.252964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.266456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 291/586] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:50.267767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.358037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de5607-c3b8-4e6c-9871-6a7bc50c57d2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.369653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f941f84-cdb3-4d68-88fe-b1941ab2ce7c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.392024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.392815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.393099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.393379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.405100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.405757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.405876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.406119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.406228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.406388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.407217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=3616916c10eb4518bef958ead7176455) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:50.407529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.408949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.423476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 292/587] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/role_assignments?user.id=3616916c10eb4518bef958ead7176455&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:50.423476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:50.432648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:50.433667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:50.434587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:50.434587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:50.434587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:50.434587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:50.439293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 296/588] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:50.440277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.521019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358b00-e05a-4d84-8e2d-540f64b6e73f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.546649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e8d14-50f6-4aa0-bbcc-28fe3ec9889a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.560786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.562530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.562829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.563432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.564246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:50.564502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.566539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.583227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 293/589] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:50.584141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.591440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.592393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.592778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.593328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.602954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.605888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:50.623247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:50.624823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:50:50.625792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:50.628407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 297/590] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:50.634194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.711979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb146361-efb0-41aa-87e7-daad8c2efcb0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.744172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054212d-1da2-48e5-a343-12c933bd525d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.750466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.751354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.751736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.752110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.753441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:50.753857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.755780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.776881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 294/591] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:50.778011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.789173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.790418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.790800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.791203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.800749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.803019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:50.820631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:50.821705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:50.822607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:50.824890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 298/592] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:50.825849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.901291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9677e-2be5-4578-83ff-ce6d74c9d1c7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.927972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee85d12c-5fea-4033-b2ff-93ddcb42f731 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:50.944497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.945400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.945768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.946116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.947342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:50.947720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.949590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:50.964325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:50.965593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:50.966060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:50.966530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:50.975198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 295/593] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:50.976491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:50.978065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:50.979811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:51.000962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:51.001981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:50:51.002940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:51.007008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 299/594] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:51.008287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.099608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30a4c-a866-44d6-8847-e32df0beed0f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.123571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5d31-07bd-4762-83d8-0feadc6cab05 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.144775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.145845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.146344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.147283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.148605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:51.149297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.151688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.161314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.162113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.162395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.162670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.167795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 296/595] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:51.168869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.174764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.175816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:51.194651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:51.195661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:51.196577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:51.196577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:51.196577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:51.196577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:51.196577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 300/596] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:51.197281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.293464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679227-1d1b-4152-9dce-44fcc8f77007 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.313140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64fa20-866f-457b-b351-f44b267074ef None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.328721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.329513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.329866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.330251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.331220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:51.331606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.333120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.355712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 297/597] 10.222.0.49 () {56 vars in 1139 bytes} [Tue May 10 20:50:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:51.356665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.359870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.361879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.362354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.362831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/69f37dda98124a8c8cf4406d985933f4/roles/bd48cc77ef9847008cb25340f9c96405` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.382349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=69f37dda98124a8c8cf4406d985933f4, role_id=bd48cc77ef9847008cb25340f9c96405)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.384812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.452416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4679b-e4d2-496c-b9fe-314aef04f11b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.479315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 301/598] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:51 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/69f37dda98124a8c8cf4406d985933f4/roles/bd48cc77ef9847008cb25340f9c96405 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:51.480527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.489288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.490136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.490426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.490706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.491657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:51.491969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.493442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.506597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 298/599] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:51.512606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.629786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a4607-b652-47d4-b444-1026b10f3f34 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.670710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.672608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.673236 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.674970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.689074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7aa6a6-e49d-4997-8908-0162eff858fb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.691445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.693984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:51.723893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:51.725023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:51.726120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:51.735346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 299/600] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:51.740776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.780917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.782059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.782484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.782900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.798810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.800324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:51.824173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:51.825134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:51.826044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:51.826044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:51.826044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:51.826044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:51.826567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 302/601] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:51.832282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.869975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f294938-9445-46f1-98b7-155a623f158e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:51.923784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:51.924548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:51.924735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:51.931151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:51.931151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:51.931151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:51.931151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:51.956401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 300/602] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:50:51.962296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:51.998817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8062b73-4d36-48a1-897c-8cbd0c592736 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:52.071947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:52.072630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.072917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.073197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.073930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:52.074240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:52.075661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:52.101067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 303/603] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:52.106499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:52.137336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e368a-8be1-462f-9525-a626290995e7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:52.193583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21470428-7234-45e4-a444-f0eacc9ad60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:52.194487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21470428-7234-45e4-a444-f0eacc9ad60d None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.194770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21470428-7234-45e4-a444-f0eacc9ad60d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.195053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21470428-7234-45e4-a444-f0eacc9ad60d None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/8f2ddd09bc4743f585cda702c3047e3f/roles/bd48cc77ef9847008cb25340f9c96405` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.227153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21470428-7234-45e4-a444-f0eacc9ad60d None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=8f2ddd09bc4743f585cda702c3047e3f, role_id=bd48cc77ef9847008cb25340f9c96405)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:52.228828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21470428-7234-45e4-a444-f0eacc9ad60d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:52.260322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02631364-3ebf-438a-9626-5fec76f2301e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:52.296501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea165d-0b30-4d9c-a345-e1d182663951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:52.299310 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea165d-0b30-4d9c-a345-e1d182663951 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.299310 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea165d-0b30-4d9c-a345-e1d182663951 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.299310 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea165d-0b30-4d9c-a345-e1d182663951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.308275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea165d-0b30-4d9c-a345-e1d182663951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:52.309740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ea165d-0b30-4d9c-a345-e1d182663951 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:52.324386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 301/604] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:51 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/8f2ddd09bc4743f585cda702c3047e3f/roles/bd48cc77ef9847008cb25340f9c96405 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-88ea165d-0b30-4d9c-a345-e1d182663951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:52.331393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:52.333446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 304/605] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a797ad-22a0-4452-a92c-21caa2f5971f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.334400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a797ad-22a0-4452-a92c-21caa2f5971f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.335003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a797ad-22a0-4452-a92c-21caa2f5971f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.335003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 305/606] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:52.335003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a797ad-22a0-4452-a92c-21caa2f5971f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:52.337689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13147-d707-4b40-931a-a8ffaa063a83 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.338511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13147-d707-4b40-931a-a8ffaa063a83 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.340002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf13147-d707-4b40-931a-a8ffaa063a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.384171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7cf13147-d707-4b40-931a-a8ffaa063a83 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:52.387180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7cf13147-d707-4b40-931a-a8ffaa063a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:52.524102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a797ad-22a0-4452-a92c-21caa2f5971f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:52.532633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 302/607] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:52.565881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf13147-d707-4b40-931a-a8ffaa063a83 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:52.569731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:52.569731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.570046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.570317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.571148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:52.571486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:52.573002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:52.586934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 306/608] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:52.592117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:52.710366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf13147-d707-4b40-931a-a8ffaa063a83 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:52.758753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd039e0e-e507-4802-87e4-6bd34d906fb4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:52.795062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870c847-f1d3-437a-b129-7476793b3d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:52.796852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c847-f1d3-437a-b129-7476793b3d7f None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.797359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c847-f1d3-437a-b129-7476793b3d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.797840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870c847-f1d3-437a-b129-7476793b3d7f None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/c298cfd105174cd89ba5ef6eb50b1601/roles/bd48cc77ef9847008cb25340f9c96405` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.814113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c847-f1d3-437a-b129-7476793b3d7f None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=c298cfd105174cd89ba5ef6eb50b1601, role_id=bd48cc77ef9847008cb25340f9c96405)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:52.815824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:52.816275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870c847-f1d3-437a-b129-7476793b3d7f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:52.816639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.816937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.817182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.841282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:52.850699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:52.851740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:52.852623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:52.855639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 303/609] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:52.861918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:52.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 307/610] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:52 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/c298cfd105174cd89ba5ef6eb50b1601/roles/bd48cc77ef9847008cb25340f9c96405 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:50:52.919748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8df0a-592b-47a9-95ad-be9949cac09a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.920493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8df0a-592b-47a9-95ad-be9949cac09a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.921803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8df0a-592b-47a9-95ad-be9949cac09a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.923707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 308/611] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:52.932964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e51080-7fa7-4495-b905-990b16020520 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:52.933262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e51080-7fa7-4495-b905-990b16020520 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:52.933528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e51080-7fa7-4495-b905-990b16020520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:52.976334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-75e51080-7fa7-4495-b905-990b16020520 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:52.977541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-75e51080-7fa7-4495-b905-990b16020520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:52.981115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec476b9-4b75-462a-ac84-d52d79fd9fe9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.018997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.020029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.020526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.021131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.022095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:53.022625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:53.024270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:53.034995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 304/612] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:53.040354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.151111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540d30a-245a-4d9a-b8f9-f13eaba638d8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.154643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 309/613] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:53.190092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.191694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.191934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e51080-7fa7-4495-b905-990b16020520 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.192358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.192818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.209488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:53.211021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:53.228886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:53.229851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:53.230763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:53.230763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:53.230763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:53.230763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:53.230763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 305/614] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:53.236780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.313186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e51080-7fa7-4495-b905-990b16020520 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.339359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f46e345-20cb-4b66-8add-2a78917f7d61 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.350297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.351496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.352014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.352300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.380746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:53.382555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.383536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.384036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.384520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.385446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:53.385950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:53.387585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:53.397073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:53.398060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:53.398920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:53.404035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 306/615] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:53.407544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 310/616] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:53.417089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.418337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.519357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331fc6f-b190-43d5-8444-e504b3a7cf85 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.554087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.555115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.555633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.556118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.557069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:53.557608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:53.559233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:53.573405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 307/617] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:53.574960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.684604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdb380-9ab1-49e1-bd77-786f3c61cfa8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.697148 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e62dae-920a-4c54-a5f0-fa3064c2a40d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.741806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.742615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.742901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.743204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.762105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.762923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.763231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.763512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.765812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:53.767306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:53.782669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:53.784200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:53.802941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:53.803965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:53.805338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 311/618] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:53.805931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:53.806738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:53.809192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:53.809192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:53.809192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:53.809192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:53.809192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 308/619] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:50:53.816141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.816394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:53.930134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d2228-5e27-4acf-b310-e1442cbd9abc None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:53.972428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:53.973039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:53.973326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:53.973609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:53.974472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:53.974787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:53.976264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.017535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 309/620] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:54.023627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.055751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6188fe8-ef97-4188-bbf2-af7efd41d5a6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.104582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.105303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.105591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.105868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.106608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:54.106914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:54.108912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.134225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 312/621] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:54.140098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.178522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74025c2e-fb0b-4869-b7d2-d0e291fdf618 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.224667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37069c43-d215-42e4-9dc8-a83bc4fbf553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.225272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069c43-d215-42e4-9dc8-a83bc4fbf553 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.225562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069c43-d215-42e4-9dc8-a83bc4fbf553 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.225837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37069c43-d215-42e4-9dc8-a83bc4fbf553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.271982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41f72-068a-445a-a0f1-72fb0a8ff659 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.307711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.308515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.308802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.309082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.316886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:54.318353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:54.333450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:54.335745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:54.338074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 313/622] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:54.343530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.429019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069c43-d215-42e4-9dc8-a83bc4fbf553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:54.430539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37069c43-d215-42e4-9dc8-a83bc4fbf553 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.460184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c220c08-1d7d-418b-8878-f50c6795d4df None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.504611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315cd45-5bd6-4ff8-b37f-c90bd5b01f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.505216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315cd45-5bd6-4ff8-b37f-c90bd5b01f2e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.505943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315cd45-5bd6-4ff8-b37f-c90bd5b01f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.506229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315cd45-5bd6-4ff8-b37f-c90bd5b01f2e None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.507088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315cd45-5bd6-4ff8-b37f-c90bd5b01f2e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:54.507799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315cd45-5bd6-4ff8-b37f-c90bd5b01f2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:54.509882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315cd45-5bd6-4ff8-b37f-c90bd5b01f2e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.529575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 314/623] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:54.531045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0118-2195-4f06-aede-28bd7536bb6c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.531392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0118-2195-4f06-aede-28bd7536bb6c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.531672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0118-2195-4f06-aede-28bd7536bb6c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.537170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 315/624] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:54.537995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0118-2195-4f06-aede-28bd7536bb6c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.540434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 310/625] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:54.542767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e5efd-8b87-43be-a55e-5d9927297a0b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.543062 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e5efd-8b87-43be-a55e-5d9927297a0b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.543371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e5efd-8b87-43be-a55e-5d9927297a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.561715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e07e5efd-8b87-43be-a55e-5d9927297a0b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:54.562909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e07e5efd-8b87-43be-a55e-5d9927297a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:54.634387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 311/626] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:54.635292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e5efd-8b87-43be-a55e-5d9927297a0b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.654094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0118-2195-4f06-aede-28bd7536bb6c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.703294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.704110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.704395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.704669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.716482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:54.718624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:54.738099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:54.747996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:54.750162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:54.750162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:54.750162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:54.750162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:54.750671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e5efd-8b87-43be-a55e-5d9927297a0b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.750841 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 316/627] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:54.750841 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.778409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.779155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.779501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.779784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.790554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:54.792095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:54.810126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:54.812584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:54.814785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:54.814785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:54.814785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:54.814785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:54.814785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 312/628] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:54.814785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.843772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2278a1-a6ff-4419-81ec-7196459e4eec None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.885125 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.885928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.886207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.886479 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.900036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:54.910935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:54.912929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:54.914805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:54.916168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4dfe8-623f-439e-b07f-be0f0e7e6ad2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:54.919403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 317/629] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:54.919403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:54.954154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:54.954818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:54.955109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:54.955414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:54.956144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:54.956453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:54.957821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:54.969955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 313/630] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:54.970797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.026186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f55dc-b5af-4e03-8864-a8bcf2041a78 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.060910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac2e18-d3b7-4334-8f7d-8223b3cd6976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.061661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2e18-d3b7-4334-8f7d-8223b3cd6976 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.061952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2e18-d3b7-4334-8f7d-8223b3cd6976 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.062231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac2e18-d3b7-4334-8f7d-8223b3cd6976 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.062961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac2e18-d3b7-4334-8f7d-8223b3cd6976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:55.063303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac2e18-d3b7-4334-8f7d-8223b3cd6976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.064788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac2e18-d3b7-4334-8f7d-8223b3cd6976 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.071682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7cecf7-01d7-4942-96a9-d5a0b9627878 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.076824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 318/631] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:55.078396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24071fc2-afaf-4638-b1a9-21f70e9a4c52 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.078825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24071fc2-afaf-4638-b1a9-21f70e9a4c52 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.079262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24071fc2-afaf-4638-b1a9-21f70e9a4c52 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.080639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 319/632] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:55.081463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24071fc2-afaf-4638-b1a9-21f70e9a4c52 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.111472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.112139 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.112418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.112691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.113432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:55.113737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.115089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.127202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 314/633] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:55.127202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.188901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24071fc2-afaf-4638-b1a9-21f70e9a4c52 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.221491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb024bf-e747-4094-a07c-f9c52f21ee01 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.223467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ec754-980b-4531-b5c0-371497979a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.224264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ec754-980b-4531-b5c0-371497979a96 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.224547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ec754-980b-4531-b5c0-371497979a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.224821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ec754-980b-4531-b5c0-371497979a96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.231819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ec754-980b-4531-b5c0-371497979a96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.234278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ec754-980b-4531-b5c0-371497979a96 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-eb6ec754-980b-4531-b5c0-371497979a96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:55.248132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:55.249338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:55.250244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 320/634] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:55.250743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920ada5-d002-4e87-9970-4009c581bd14 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.251207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920ada5-d002-4e87-9970-4009c581bd14 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.251207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920ada5-d002-4e87-9970-4009c581bd14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.261685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.262486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.262777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.263056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.268612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b920ada5-d002-4e87-9970-4009c581bd14 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:55.270079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b920ada5-d002-4e87-9970-4009c581bd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:55.270410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.271897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:55.286861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:55.287848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:55.288745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 315/635] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:55.289698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.344766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 321/636] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:55.345401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920ada5-d002-4e87-9970-4009c581bd14 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.401807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda3fba9-4c10-4eca-aed3-d56fea6f55bb None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.436805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.437596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.437874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.438146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.447988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.449409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.465030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920ada5-d002-4e87-9970-4009c581bd14 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:55.466714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:55.468254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:55.469180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:55.469180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:55.469180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:55.469180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:55.469180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 316/637] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:55.469476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.502125 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.503210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.503612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.503960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.504823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:55.505195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.506712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.523478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 322/638] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:55.523478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.566470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b6fed-aa54-4e61-bd6b-1c01d8316674 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.602015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.602615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.602897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.603484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.604013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:55.604323 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.605777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.618750 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 317/639] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:55.619600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.630598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e55cab-52bb-4780-9147-755f507993cc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.663478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.664265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.664546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.664819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.675413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:55.682842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:55.684035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 323/640] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:55.684899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.718602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dedab4-55cb-4a4e-8466-26899ea21aad None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.751007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714d7b-a592-4d8e-9217-9d408a802f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.751715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714d7b-a592-4d8e-9217-9d408a802f80 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.752004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714d7b-a592-4d8e-9217-9d408a802f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.752285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714d7b-a592-4d8e-9217-9d408a802f80 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.753015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714d7b-a592-4d8e-9217-9d408a802f80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:55.753326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714d7b-a592-4d8e-9217-9d408a802f80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.754691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714d7b-a592-4d8e-9217-9d408a802f80 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.766888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 318/641] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:55.768162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77169b-4733-4fa6-b3f1-9bd86e8e138a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.768450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77169b-4733-4fa6-b3f1-9bd86e8e138a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.768757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77169b-4733-4fa6-b3f1-9bd86e8e138a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.774026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 319/642] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:55.774026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77169b-4733-4fa6-b3f1-9bd86e8e138a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.788564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78aea9-7f95-4643-a244-cfae4e1272e7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.820816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.821693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.821977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.822252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/3616916c10eb4518bef958ead7176455/roles/bd48cc77ef9847008cb25340f9c96405` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.836695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=3616916c10eb4518bef958ead7176455, role_id=bd48cc77ef9847008cb25340f9c96405)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.838128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.870969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77169b-4733-4fa6-b3f1-9bd86e8e138a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:55.904188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:55.904580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 324/643] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:50:55 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/3616916c10eb4518bef958ead7176455/roles/bd48cc77ef9847008cb25340f9c96405 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:50:55.905012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:55.905442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:55.907396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:55.907768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:55.908584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=dd4bf9aaaae4483bade1570b1c1cfae7) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:55.908902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:55.910375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:55.927151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 320/644] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/role_assignments?user.id=dd4bf9aaaae4483bade1570b1c1cfae7&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:55.927151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.053415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04644139-af52-4e41-83b7-9282267800d6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.060983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c591c-d9fe-45b3-9125-367797ac2bf9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.102210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26703db3-6c85-470d-a031-015bddd78e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.103239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26703db3-6c85-470d-a031-015bddd78e39 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.103678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26703db3-6c85-470d-a031-015bddd78e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.104099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26703db3-6c85-470d-a031-015bddd78e39 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.104228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.106253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.106253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.106253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.107292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26703db3-6c85-470d-a031-015bddd78e39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:56.107761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26703db3-6c85-470d-a031-015bddd78e39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.109962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26703db3-6c85-470d-a031-015bddd78e39 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.116230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.118019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.119857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 325/645] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:56.121442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cf449-14f4-40e8-bb2d-e06f0d2c9c0b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.121899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cf449-14f4-40e8-bb2d-e06f0d2c9c0b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.122327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cf449-14f4-40e8-bb2d-e06f0d2c9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:56.134259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:56.135332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 10 20:50:56.136384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:56.137956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 321/646] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:56.137956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.143931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c03cf449-14f4-40e8-bb2d-e06f0d2c9c0b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:56.145121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c03cf449-14f4-40e8-bb2d-e06f0d2c9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:56.227617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 326/647] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:56.228490 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cf449-14f4-40e8-bb2d-e06f0d2c9c0b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.269263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2b08a-9afe-49e2-9a6a-5e74ab8eb257 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.304612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.305759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.306267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.306775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.317662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.319435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:56.343748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:56.344788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:56.345710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:56.345710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:56.345710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:56.345710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:56.348665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 322/648] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:56.348865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cf449-14f4-40e8-bb2d-e06f0d2c9c0b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.349955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.391603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.392329 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.392616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.392888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.394547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:56.394863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.396326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.416779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 327/649] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:56.417684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.476927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3ef7-876f-4b63-acf0-83e283a39886 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.512193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.513160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.513525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.513903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.521312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ef79c-5a8d-47ec-93e6-178621a5af58 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.525500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:56.533616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:56.534863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:56.535972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:56.537816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 323/650] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:56.538787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.560773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.562301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.562838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.563337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.564260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:56.564803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.566454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.579472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 328/651] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:56.580608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.644054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df298cd6-1f5f-4588-8945-97b748b7f5ab None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.678416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.679091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.679403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.679681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.687565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d7355-ad8d-46ee-85b7-cf0931198551 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.725194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.725867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.726155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.726435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.727232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:56.727550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.728952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.738267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 329/652] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:56.739093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.750618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.752102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.843305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb729f24-0055-49cb-9934-007477466c20 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.856564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 324/653] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:56.857498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.882728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.883569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.883858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.884139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:56.892486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:56.893950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:56.908601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:56.910027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 330/654] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:56.911896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:56.963414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71fbcd-9638-4097-af1c-83e678a65ffa None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:56.997936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:56.998727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:56.999645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:56.999931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.009876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.011358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.011970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac034c-33a3-43db-ba08-573eaaa68bd2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:57.029182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:57.031960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:57.034190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:57.034190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:57.034190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:57.034190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:57.034190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 325/655] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:57.034190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.049505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.050468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.050756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.051357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.065205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.067294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:57.088637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:57.090453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:57.092052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:57.092052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:57.092052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:57.092052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:57.095219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 331/656] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:57.095846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.135511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ab40b-11b0-4fa7-8851-2fcda1440b4d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.175770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.176457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.176741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.177019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.177892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:57.178202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.179702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.198203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9747-e573-438b-a440-1a3b4df66756 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.198510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 326/657] 10.222.0.49 () {56 vars in 1137 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:57.199421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.235458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.236348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.237553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.237860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.238625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:57.238940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.240385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.252953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 332/658] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:57.253794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.310020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214959ad-a631-4d03-9406-9bce717e6334 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.352000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.352923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.353356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.353778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.355206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:57.355940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.358024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.366862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80591f0a-3fb4-4023-956e-dfbd7109fd94 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.373129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 327/659] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:57.374796 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.409388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.410372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.410665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.410947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.493728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.494789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f0f73-7c5c-427d-bfb3-6403decc26f7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.495149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.533093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.534177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.534637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.535063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.543044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.544701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:50:57.560140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:57.561361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 10 20:50:57.562917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:57.565108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 328/660] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:57.566195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.615241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 333/661] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:57.616459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.684120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b94d06-079b-4698-ba3c-344e6cca5c1d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.718724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41959d4-cbb1-41e9-aa06-af2310e3db67 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.726499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.729369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.729651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.729926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.739667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.741137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:57.756527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:57.757442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:57.758381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:57.762675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 329/662] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:57.763588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.766462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.768402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.769053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.769541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.770671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:57.771232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.773363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.804526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 334/663] 10.222.0.49 () {56 vars in 1139 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:57.806138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.868081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054770-5a15-462c-9ec0-756862ac07e9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.902963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.903849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.904061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.904341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.915659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.917200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.926221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964fe97e-c755-4179-adaa-fca0f59ba1df None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:57.935720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:57.937813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:57.938756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:57.938756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:57.938756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:57.938756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:57.938756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 330/664] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:57.938756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:57.967228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:57.969424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:57.969918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:57.970395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:57.971437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:57.971967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:57.973609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:57.991200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 335/665] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:57.992383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.041998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039a644-23ff-4526-b5ca-7c4190bee8d1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.078382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.079070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.079429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.079711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.099235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a082a-64ec-40cc-9968-771d6b5ec074 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.136755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.137820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.138309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.138815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.140743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:58.141341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.142980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.153284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.154767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.158539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 336/666] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:58.159710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.262247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 331/667] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:50:58.263211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.269578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0ac8f-7e48-4e09-baf5-80791a68c150 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.306238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.307274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.307796 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.308280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.309344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=69f37dda98124a8c8cf4406d985933f4) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:58.309867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.311980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.318278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 337/668] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/role_assignments?user.id=69f37dda98124a8c8cf4406d985933f4&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:58.319351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.372611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0946f-3e97-4466-b531-a984879a3168 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.411735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722047f2-29cd-49df-9139-0a5178f38817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.412751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722047f2-29cd-49df-9139-0a5178f38817 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.413035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722047f2-29cd-49df-9139-0a5178f38817 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.413845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722047f2-29cd-49df-9139-0a5178f38817 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.421042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722047f2-29cd-49df-9139-0a5178f38817 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.422551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722047f2-29cd-49df-9139-0a5178f38817 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-722047f2-29cd-49df-9139-0a5178f38817 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:58.436981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:58.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:58.439335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 332/669] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:58.439913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69d62-0b11-4d59-9526-88f01d6f7ba4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.440205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69d62-0b11-4d59-9526-88f01d6f7ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.440484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a69d62-0b11-4d59-9526-88f01d6f7ba4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.445912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 333/670] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:58.445912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111b897-7247-4f0e-a261-895453f669b6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.445912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111b897-7247-4f0e-a261-895453f669b6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.445912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111b897-7247-4f0e-a261-895453f669b6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.445912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 334/671] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:50:58.446331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111b897-7247-4f0e-a261-895453f669b6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.461174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edddb7-43d9-4a1e-8c1a-32fc1e023ba3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.499775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ca120-d4f9-41d6-9c2b-9c0a0183b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.500692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca120-d4f9-41d6-9c2b-9c0a0183b522 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.500974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca120-d4f9-41d6-9c2b-9c0a0183b522 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.501246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ca120-d4f9-41d6-9c2b-9c0a0183b522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.513771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ca120-d4f9-41d6-9c2b-9c0a0183b522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.516094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ca120-d4f9-41d6-9c2b-9c0a0183b522 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9b6ca120-d4f9-41d6-9c2b-9c0a0183b522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:58.534802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:58.536358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 338/672] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d97fd-d578-486e-abb2-bf47723cf69a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d97fd-d578-486e-abb2-bf47723cf69a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.538480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d97fd-d578-486e-abb2-bf47723cf69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.556481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-df7d97fd-d578-486e-abb2-bf47723cf69a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:58.557775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-df7d97fd-d578-486e-abb2-bf47723cf69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:58.566229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1111b897-7247-4f0e-a261-895453f669b6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.610962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6913a8-6370-4df9-bd35-9fa4f0d575b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.611756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6913a8-6370-4df9-bd35-9fa4f0d575b6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.612039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6913a8-6370-4df9-bd35-9fa4f0d575b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.612310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6913a8-6370-4df9-bd35-9fa4f0d575b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.613104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6913a8-6370-4df9-bd35-9fa4f0d575b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:58.613410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6913a8-6370-4df9-bd35-9fa4f0d575b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.614823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6913a8-6370-4df9-bd35-9fa4f0d575b6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.627728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 335/673] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:58.629045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2fd5-4b79-4832-af4b-1861e8f1dcc8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.629417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2fd5-4b79-4832-af4b-1861e8f1dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.629764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f2fd5-4b79-4832-af4b-1861e8f1dcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.637998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 339/674] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:58.638925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d97fd-d578-486e-abb2-bf47723cf69a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.649436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2f5f2fd5-4b79-4832-af4b-1861e8f1dcc8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:50:58.651356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2f5f2fd5-4b79-4832-af4b-1861e8f1dcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:50:58.721981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 336/675] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:50:58.723307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2fd5-4b79-4832-af4b-1861e8f1dcc8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.759518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d97fd-d578-486e-abb2-bf47723cf69a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.793093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.793816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.794046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.794324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.795050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:58.795719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.797318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.813711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 340/676] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:58.813711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.830017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5f2fd5-4b79-4832-af4b-1861e8f1dcc8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.866806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.867504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.867778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.868093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.868874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=8f2ddd09bc4743f585cda702c3047e3f) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:58.869183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:58.870595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:58.876928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 337/677] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/role_assignments?user.id=8f2ddd09bc4743f585cda702c3047e3f&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:58.880572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:58.914158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b05c-5b59-404c-afe8-7f44565271b5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:58.952980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:58.953793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:58.954678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:58.954678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:58.966611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:58.974873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:58.975975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:58.976837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 341/678] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:58.977545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.011896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114b0bc-bcd1-4b5f-8f39-2fa785849441 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.049553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.050756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.051312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.051787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.064338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:50:59.072319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:59.073283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:50:59.074118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:59.076736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 338/679] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:59.078113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.090512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f878c4-a513-4a81-a78a-ec0a9dde1dfc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.127749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.128440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.128721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.128994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.136654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.138114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:50:59.154219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:59.155964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:59.156905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 342/680] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:59.157847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.195474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334b5a7-3fa8-49f7-8779-1480665e0352 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.230094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.230861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.231264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.231637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.232420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:59.232793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.234981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.243744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 339/681] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:59.247976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.287881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f7251-c56c-43e3-ab7a-35ad74f30eb7 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.323692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.324666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.325137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.325596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.326531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:59.327926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.329525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.338477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 343/682] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:59.339570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.357134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff65b06-57eb-451a-841a-6deb63791dfe None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.392218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.392926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.393205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.393477 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.394703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:59.395030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.396791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.414067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 340/683] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:59.415008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.442562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494739f0-2adc-4117-9850-236c664f45ad None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.479634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.480795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.481287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.482042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.493409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.495212 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:59.513514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:59.514621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:59.515724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:59.515724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:59.515724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:59.515724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:50:59.517954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 344/684] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:59.518977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.539696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96173319-2983-42de-ac7e-aec1a8d4c9c3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.585489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.586207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.586488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.586763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.600458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.604515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.629045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0acb-bcec-42a3-9afa-0f7995a8a876 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:50:59.629261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:50:59.630087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:50:59.630999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:50:59.630999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:50:59.630999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:50:59.630999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:50:59.634482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 341/685] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:50:59.636161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.669397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.671491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.671997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.672647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.674161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=c298cfd105174cd89ba5ef6eb50b1601) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:59.674802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.676621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.684485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 345/686] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/role_assignments?user.id=c298cfd105174cd89ba5ef6eb50b1601&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:59.685944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.813970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacea9dd-9361-48db-9d76-d488d4bc0724 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.882694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.883437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.883718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.883991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.884721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:59.884936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33670752-65f6-487e-92c7-f6c2819a4e8b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:50:59.885044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.886374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.901347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 342/687] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:59.907658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:50:59.932942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:50:59.933608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:50:59.933887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:50:59.934160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:50:59.934879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:50:59.935239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:50:59.936908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:50:59.956480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 346/688] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:50:59.959853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.033652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1472a113-bdac-4fe6-bbf9-2b1e4c31f6cb None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.068696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.069515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.069795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.070067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.078664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.080133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.082163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d78fd-abbd-45d8-afc2-6b6d2d832f95 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:00.094295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:00.095452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:00.097080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 343/689] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:00.101573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.123300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.128253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.128919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.129431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.137810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.139617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:00.156728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:00.157763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:00.158778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:00.165671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 347/690] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:50:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:00.167213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.204710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9f40e-d8e6-4fb6-b9af-c03927548733 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.240616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.241353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.241589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.241841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.242686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:00.242994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.244551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.264634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 344/691] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:00.270169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.284599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a3a1c-f278-4ac6-965f-52519ba43b0f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.321388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.322418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.322940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.323446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.324545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:00.325105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.326771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.351244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 348/692] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:00.352780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.374930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f376a-8932-44d3-b3f7-f8f59fb5e1a5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.409594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.410173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.410452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.410731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.461315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fe463-e82d-461c-9955-e7fc1340bef5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.480827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.482387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.500958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436ad4-0307-458d-b524-68eef04c835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.501999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436ad4-0307-458d-b524-68eef04c835f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.502491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436ad4-0307-458d-b524-68eef04c835f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.503002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436ad4-0307-458d-b524-68eef04c835f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.577523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436ad4-0307-458d-b524-68eef04c835f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.579960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436ad4-0307-458d-b524-68eef04c835f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.632724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 345/693] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:51:00.638311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.694915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 349/694] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 10 20:51:00.696709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35b78d-d9a2-4805-bb5e-00dc0412ac9b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.697210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35b78d-d9a2-4805-bb5e-00dc0412ac9b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.697688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35b78d-d9a2-4805-bb5e-00dc0412ac9b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.699220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 350/695] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:00.700506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35b78d-d9a2-4805-bb5e-00dc0412ac9b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.759347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10d95a-9e3e-41c9-b6e9-6259048d11b8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.792562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06e9410-177a-4f32-89ed-120463caf430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.793261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e9410-177a-4f32-89ed-120463caf430 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.793543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e9410-177a-4f32-89ed-120463caf430 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.793814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06e9410-177a-4f32-89ed-120463caf430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.805146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e9410-177a-4f32-89ed-120463caf430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.806524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06e9410-177a-4f32-89ed-120463caf430 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.811801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35b78d-d9a2-4805-bb5e-00dc0412ac9b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a06e9410-177a-4f32-89ed-120463caf430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:00.824493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:00.825449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:00.827494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:00.827494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:00.827494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:00.827494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:00.830870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 346/696] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:00.832234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b28384-aa09-4744-adc4-bdf15fa2075e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.832518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b28384-aa09-4744-adc4-bdf15fa2075e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.832794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b28384-aa09-4744-adc4-bdf15fa2075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.851345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-92b28384-aa09-4744-adc4-bdf15fa2075e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:00.852607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:00.852737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-92b28384-aa09-4744-adc4-bdf15fa2075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:00.853407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:00.853750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:00.854027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:00.865763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:00.867326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:00.885924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:00.886886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:00.887834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:00.887834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:00.887834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:00.887834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:00.892388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 351/697] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:00.893252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:00.922584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 347/698] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:51:00.923468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b28384-aa09-4744-adc4-bdf15fa2075e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.011878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8015b883-8111-47dc-aad8-48dc13f8df44 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.050622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.051352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.051636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.052023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.052829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:01.053137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.054508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.058162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b28384-aa09-4744-adc4-bdf15fa2075e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.071227 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 352/699] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:01.072132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.097027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.097706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.097991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.098266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.098996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:01.099324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.100709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.117785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 348/700] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:01.118678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.177025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf67e92-6806-42bf-974d-9cfe4add543c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.212405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.213241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.213524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.213801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.222976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5b5cf-e313-4816-a462-c7e53b9136ca None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.225291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.226754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:01.244057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:01.246130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:01.248288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:01.248288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:01.248288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:01.248288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:01.248288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 353/701] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:01.248288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.262506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.263268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.263553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.263830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.271674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.273117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:01.290674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:01.292803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:01.294938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 349/702] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:01.303146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.372892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd1af0-e8fe-400b-b671-ad50b1275a33 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.405878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35163d-2b7c-4121-be6d-20b1254e8e0c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.408425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.409228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.409507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.409781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.418340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.419835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:01.434986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:01.437650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 354/703] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:01.439830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.446790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.447484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.447768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.448042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.448773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:01.449077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.450432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.466519 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 350/704] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:01.467493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.544268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b22265-b965-4659-92c7-b2bc5f952498 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.569325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6be2bc-a671-4193-82a2-39746db166ac None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.580353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.581091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.581370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.581643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.582525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:01.582833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.584307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.595799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 355/705] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:01.595799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.613684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d33c8d-c3c9-4d67-a47f-ca62551e0b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.614589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33c8d-c3c9-4d67-a47f-ca62551e0b27 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.615028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33c8d-c3c9-4d67-a47f-ca62551e0b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.615476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d33c8d-c3c9-4d67-a47f-ca62551e0b27 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.616427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d33c8d-c3c9-4d67-a47f-ca62551e0b27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:01.616882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d33c8d-c3c9-4d67-a47f-ca62551e0b27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.618442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d33c8d-c3c9-4d67-a47f-ca62551e0b27 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.632049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 351/706] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:01.638443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48075d83-b966-42d5-adb6-e0d7059a79f4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.638443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48075d83-b966-42d5-adb6-e0d7059a79f4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.638443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48075d83-b966-42d5-adb6-e0d7059a79f4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.643172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 352/707] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:01.643172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48075d83-b966-42d5-adb6-e0d7059a79f4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.704071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf316b-3fae-48b2-8c1e-bd3bc82f993a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.737379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359b079-7f48-40e5-9084-ea5bf01ee653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.738040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359b079-7f48-40e5-9084-ea5bf01ee653 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.738326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359b079-7f48-40e5-9084-ea5bf01ee653 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.738601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359b079-7f48-40e5-9084-ea5bf01ee653 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.739337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359b079-7f48-40e5-9084-ea5bf01ee653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.740814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359b079-7f48-40e5-9084-ea5bf01ee653 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.746325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48075d83-b966-42d5-adb6-e0d7059a79f4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:01.779052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:01.779805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.780609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.780880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.781703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=3616916c10eb4518bef958ead7176455) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:01.782012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:01.783446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:01.789054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 353/708] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/role_assignments?user.id=3616916c10eb4518bef958ead7176455&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:01.789817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:01.817507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 356/709] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:51:01 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:01.817507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d247e-c089-4874-9c38-5c8c52bef96c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:01.817507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d247e-c089-4874-9c38-5c8c52bef96c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:01.817507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d247e-c089-4874-9c38-5c8c52bef96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:01.846112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-475d247e-c089-4874-9c38-5c8c52bef96c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:01.847402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-475d247e-c089-4874-9c38-5c8c52bef96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:01.998589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 357/710] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:51:01.999605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8851c1-f456-47af-9a0a-3374f40c5962 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:02.030319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d247e-c089-4874-9c38-5c8c52bef96c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:02.047981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:02.048950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:02.049232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:02.049505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:02.050527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=dd4bf9aaaae4483bade1570b1c1cfae7) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:02.051329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:02.053044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:02.063233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 354/711] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:01 2022] GET /identity/v3/role_assignments?user.id=dd4bf9aaaae4483bade1570b1c1cfae7&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:02.160981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475d247e-c089-4874-9c38-5c8c52bef96c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:02.200311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:02.201144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:02.201446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:02.201705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:02.202954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:02.204438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:02.220653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:02.221688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:02.222561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 358/712] 10.222.0.49 () {56 vars in 1129 bytes} [Tue May 10 20:51:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:02.230718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:02.346377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645e9b1-2e3e-439c-9882-6a57b93bcabc None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:02.388147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ec43a-df43-4f72-826b-f1802662ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:02.388883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec43a-df43-4f72-826b-f1802662ca0f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:02.389166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec43a-df43-4f72-826b-f1802662ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:02.389483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ec43a-df43-4f72-826b-f1802662ca0f None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:02.390853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ec43a-df43-4f72-826b-f1802662ca0f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:02.391189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ec43a-df43-4f72-826b-f1802662ca0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:02.392708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ec43a-df43-4f72-826b-f1802662ca0f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:02.397910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 355/713] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 20:51:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:02.403471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:02.534288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fc137-f445-4879-881d-c99f615c7b8f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:02.568443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80d430-2f88-4de7-a568-3bc496d59216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:02.569112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80d430-2f88-4de7-a568-3bc496d59216 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:02.569391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80d430-2f88-4de7-a568-3bc496d59216 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:02.569669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80d430-2f88-4de7-a568-3bc496d59216 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:02.570379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80d430-2f88-4de7-a568-3bc496d59216 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:02.570689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80d430-2f88-4de7-a568-3bc496d59216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:02.572087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80d430-2f88-4de7-a568-3bc496d59216 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:02.578622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 359/714] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 20:51:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:02.631440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94727ac2-099c-40bc-8be6-c7e376e62e56 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:02.631777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94727ac2-099c-40bc-8be6-c7e376e62e56 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:02.632061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94727ac2-099c-40bc-8be6-c7e376e62e56 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:02.633554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 356/715] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:02.650400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cea2-7fe6-4d8c-9416-f468c88fdefa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:02.650719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cea2-7fe6-4d8c-9416-f468c88fdefa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:02.650957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340cea2-7fe6-4d8c-9416-f468c88fdefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:02.672841 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7340cea2-7fe6-4d8c-9416-f468c88fdefa None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:02.674122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7340cea2-7fe6-4d8c-9416-f468c88fdefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:02.776176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 360/716] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:51:02.812704 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94727ac2-099c-40bc-8be6-c7e376e62e56 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:02.926897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94727ac2-099c-40bc-8be6-c7e376e62e56 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:02.962993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:02.964186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:02.964686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:02.965154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] PATH_INFO: `/v3/services/network` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:02.966005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:02.967673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:02.981671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:02.982765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:02.984220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:02.987196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 357/717] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:02 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:02.992847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340cea2-7fe6-4d8c-9416-f468c88fdefa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:03.141710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340cea2-7fe6-4d8c-9416-f468c88fdefa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:03.192768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e460fc-6d2b-4f0b-abc4-7651881d8777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:03.193439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e460fc-6d2b-4f0b-abc4-7651881d8777 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:03.193721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e460fc-6d2b-4f0b-abc4-7651881d8777 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:03.193993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e460fc-6d2b-4f0b-abc4-7651881d8777 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:03.194700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e460fc-6d2b-4f0b-abc4-7651881d8777 None admin] RBAC: Adding query filter params (name=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:03.195001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e460fc-6d2b-4f0b-abc4-7651881d8777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:03.196396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e460fc-6d2b-4f0b-abc4-7651881d8777 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:03.206966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 361/718] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:03.212600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:03.377924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18681c20-ab20-429e-a3f1-72de1a2e3105 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:03.431509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d6b97-ac02-4e5b-bc81-feba3e170128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:03.432103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d6b97-ac02-4e5b-bc81-feba3e170128 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:03.432388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d6b97-ac02-4e5b-bc81-feba3e170128 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:03.432663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d6b97-ac02-4e5b-bc81-feba3e170128 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:03.433382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d6b97-ac02-4e5b-bc81-feba3e170128 None admin] RBAC: Adding query filter params (type=network) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:03.433688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d6b97-ac02-4e5b-bc81-feba3e170128 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:03.435065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d6b97-ac02-4e5b-bc81-feba3e170128 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:03.444016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 358/719] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:03 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:04.499534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5641-cebb-4680-aa03-bfe745463a16 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:04.500567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5641-cebb-4680-aa03-bfe745463a16 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:04.501052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf5641-cebb-4680-aa03-bfe745463a16 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:04.502931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 362/720] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:04.512593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034de46-0864-4367-981b-d56b6d06e06e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:04.513479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034de46-0864-4367-981b-d56b6d06e06e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:04.513953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034de46-0864-4367-981b-d56b6d06e06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:04.531713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a034de46-0864-4367-981b-d56b6d06e06e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:04.533196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a034de46-0864-4367-981b-d56b6d06e06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:04.619304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 359/721] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:51:04.654326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf5641-cebb-4680-aa03-bfe745463a16 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:04.764401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e74f0-8e4b-4d1e-9135-75489445f5e2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:04.765113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e74f0-8e4b-4d1e-9135-75489445f5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:04.765113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e74f0-8e4b-4d1e-9135-75489445f5e2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:04.766475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 360/722] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:04.772003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672791-5a3a-4a6b-bc18-3c04d5581ad4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:04.772294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672791-5a3a-4a6b-bc18-3c04d5581ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:04.772576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90672791-5a3a-4a6b-bc18-3c04d5581ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:04.786396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf5641-cebb-4680-aa03-bfe745463a16 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:04.826382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-90672791-5a3a-4a6b-bc18-3c04d5581ad4 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:04.826382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-90672791-5a3a-4a6b-bc18-3c04d5581ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:04.826669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:04.826669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:04.826669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:04.826669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:04.836593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:04.845140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:04.846130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:51:04.846999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:04.847697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 363/723] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:04.853626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:04.933550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 361/724] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 10 20:51:04.935390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2c43-25be-4c24-bc5d-1a32c75da84f None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:04.935690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2c43-25be-4c24-bc5d-1a32c75da84f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:04.935971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e2c43-25be-4c24-bc5d-1a32c75da84f None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:04.937703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 362/725] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:04.942945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84529b6-f383-405c-8355-934d37907ada None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:04.943278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84529b6-f383-405c-8355-934d37907ada None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:04.943565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84529b6-f383-405c-8355-934d37907ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:04.977217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b84529b6-f383-405c-8355-934d37907ada None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:04.978416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b84529b6-f383-405c-8355-934d37907ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:04.998457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc1775-7a98-48c8-a148-51a8ef8d1548 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.036191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.037220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.037715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.038188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.039185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:05.039698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.041294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.055144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 363/726] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:51:05.055144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84529b6-f383-405c-8355-934d37907ada None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.060247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 364/727] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:05.065995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.147987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84529b6-f383-405c-8355-934d37907ada None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.184695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f353a8-e06b-4a0c-82ce-84b12d26dc14 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.185276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.186081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.186631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.187111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.197340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:05.205602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:05.206566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:05.207478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 364/728] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:05.208179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.225573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.226610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.227073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.227538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.239888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.241656 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:05.261350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:05.262335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:05.263290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:05.263290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:05.263290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:05.263290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:05.266749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 365/729] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:05.267816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.315157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3ad65-e0b0-4e39-b307-bd56f125a46d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.350218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.351084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.351400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.351677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.364504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:05.372516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:05.373534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:05.375026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:05.379436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 365/730] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:05.380373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.387064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e89e3a-193c-4835-ab31-a62ba64c5ccf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.423649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.424680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.425169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.425646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.426596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:05.427153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.428741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.438446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 366/731] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:05.439608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.486686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408fc84-80f7-4bb9-bc81-14cb35a09b24 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.520301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.520942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.521230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.521553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.522279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:05.522584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.523982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.536673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 366/732] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:05.537626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.552821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d914a-a073-4a25-9b78-8e361676ba26 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.587311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27074f3c-8b99-4307-90ca-84405af86496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.587983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074f3c-8b99-4307-90ca-84405af86496 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.588263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074f3c-8b99-4307-90ca-84405af86496 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.588535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27074f3c-8b99-4307-90ca-84405af86496 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.589277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074f3c-8b99-4307-90ca-84405af86496 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:05.589580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074f3c-8b99-4307-90ca-84405af86496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.590964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27074f3c-8b99-4307-90ca-84405af86496 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.602902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 367/733] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:05.606070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaa908-24e1-4877-b68a-3ed66eb4edb3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.606507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaa908-24e1-4877-b68a-3ed66eb4edb3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.606914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eaa908-24e1-4877-b68a-3ed66eb4edb3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.611660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 368/734] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:05.616532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaa908-24e1-4877-b68a-3ed66eb4edb3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.645566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3eb18-5ef6-4098-8308-d7cf05371915 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.683625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.684419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.684704 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.684980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.696373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.697818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:05.715797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:05.716728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:05.718259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:05.718259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:05.718259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:05.718259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:05.718259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 367/735] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:05.719073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.729952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eaa908-24e1-4877-b68a-3ed66eb4edb3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.765321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.766153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.766415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.766689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.822452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b88d6-359c-4161-af0f-71d7ec3d8125 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:05.860824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c05281-1ae7-4a97-9e2c-522fd8fdb700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:05.861870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05281-1ae7-4a97-9e2c-522fd8fdb700 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.862332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05281-1ae7-4a97-9e2c-522fd8fdb700 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.862762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c05281-1ae7-4a97-9e2c-522fd8fdb700 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.874134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c05281-1ae7-4a97-9e2c-522fd8fdb700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.876095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c05281-1ae7-4a97-9e2c-522fd8fdb700 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-78c05281-1ae7-4a97-9e2c-522fd8fdb700 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:05.895093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:05.896215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:05.897123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:05.897123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:05.897123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:05.897123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:05.897352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:05.897429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 368/736] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:05.898107 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:05.898893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f374a-941d-44c9-b5be-4f8919dae530 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:05.899333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f374a-941d-44c9-b5be-4f8919dae530 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:05.899676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f374a-941d-44c9-b5be-4f8919dae530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:05.917964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:05.918967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:05.920011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:05.920870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-356f374a-941d-44c9-b5be-4f8919dae530 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:05.920870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-356f374a-941d-44c9-b5be-4f8919dae530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:05.926111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 369/737] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:05.926111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:05.991170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 369/738] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:51:05.991395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f374a-941d-44c9-b5be-4f8919dae530 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.030856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4521de3-fa01-4c7f-aeba-0e50c5030b3c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.065914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.066571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.066850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.067144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.067867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:06.068172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.069548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.080600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 370/739] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:06.081425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.104660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f374a-941d-44c9-b5be-4f8919dae530 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.143395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.144412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.144789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.145069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.145795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:06.146100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.147564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.163691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 370/740] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:06.163691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.189506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e29d85-1bc9-4f4e-9295-e31474f16a07 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.221885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.222552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.222835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.223110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.223969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:06.224278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.225713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.242820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 371/741] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:06.243984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.262578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217e423-ae52-4825-b62c-c126b3eab682 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.295304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.296325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.296615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.296889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.297618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.298973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.343044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39697e8-f4a9-4d6b-994d-cf59fb86ca0f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.377052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.377840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.378123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.378400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.385329 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.386814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:06.401407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:06.402389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:06.403468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:06.404010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 371/742] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:06 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:06.404767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.407457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 372/743] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:06.408218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.517939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67721fac-f023-409f-969f-d39f6c4e6a05 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.530005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319c295-a3ad-4f2a-9917-0835127a6e74 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.554929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.555655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.555909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.556187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.567648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7eeeaf-3f0d-4206-ade4-3f2bb1c840a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.568462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eeeaf-3f0d-4206-ade4-3f2bb1c840a6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.568746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eeeaf-3f0d-4206-ade4-3f2bb1c840a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.569022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7eeeaf-3f0d-4206-ade4-3f2bb1c840a6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.576739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eeeaf-3f0d-4206-ade4-3f2bb1c840a6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.579090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7eeeaf-3f0d-4206-ade4-3f2bb1c840a6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-db7eeeaf-3f0d-4206-ade4-3f2bb1c840a6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:06.594102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:06.595155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:06.596146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 372/744] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:06.598676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5089d-884b-4408-9bbd-7b8703e73aa2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.598676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5089d-884b-4408-9bbd-7b8703e73aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.598676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5089d-884b-4408-9bbd-7b8703e73aa2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.600761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 373/745] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:06.600761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5089d-884b-4408-9bbd-7b8703e73aa2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.636933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.638386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.714588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5089d-884b-4408-9bbd-7b8703e73aa2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.747027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 373/746] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:51:06.748090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.755620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89902f83-1224-497d-bbd0-869dd76a5289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.756291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902f83-1224-497d-bbd0-869dd76a5289 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.756643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902f83-1224-497d-bbd0-869dd76a5289 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.756930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89902f83-1224-497d-bbd0-869dd76a5289 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.757778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902f83-1224-497d-bbd0-869dd76a5289 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:06.758083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902f83-1224-497d-bbd0-869dd76a5289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.759532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89902f83-1224-497d-bbd0-869dd76a5289 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.776897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 374/747] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:06.776897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21b72-16cc-45cc-84d5-66f7c2921fcc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.776897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21b72-16cc-45cc-84d5-66f7c2921fcc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.776897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e21b72-16cc-45cc-84d5-66f7c2921fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.797044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a5e21b72-16cc-45cc-84d5-66f7c2921fcc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:06.798380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a5e21b72-16cc-45cc-84d5-66f7c2921fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:06.853914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6f355-eb60-4b93-b23b-c5da2d981ac8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:06.864291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 375/748] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 10 20:51:06.865152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21b72-16cc-45cc-84d5-66f7c2921fcc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.897949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:06.898619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:06.898903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:06.899219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:06.900074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:06.900372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:06.901791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:06.919406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 374/749] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:06.920990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:06.976855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e21b72-16cc-45cc-84d5-66f7c2921fcc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.010782 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.011604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.011885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.012159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.021700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d3b6f-8534-45c5-b9d3-e649b291065e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.022333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.023786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:07.041359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:07.042309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:07.043248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:07.043248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:07.043248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:07.043248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:07.043248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 376/750] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:07.043526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.064710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.065355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.065637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.065909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.133831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.135308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.141884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefd8a0-ec80-4fc5-a6a4-290df4b6b6ea None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.176167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.176830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.177113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.177388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.178116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.179518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.234277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 375/751] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:06 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 10 20:51:07.234671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.283181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 377/752] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:07 2022] POST /identity/v3/services => generated 240 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:07.283181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.338831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef696a-eaaf-4cb8-8db1-2783e4847852 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.383525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.384376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.384660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.384934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.396887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.398373 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.405796 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e475d6-8757-4b2b-98ad-ad4b5f340d09 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:07.418158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:07.419148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:07.420070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:07.420070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:07.420070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:07.420070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:07.420070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 376/753] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:07.422126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.443500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.444186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.444474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.444756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.445501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:07.445810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.447281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.462033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 378/754] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:07.462975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.536451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e4172-8805-4a86-a82a-80dea114f112 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.570866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f33e04-5698-49c0-8b63-1c7f856e6525 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.578273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.579087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.579561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.579850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.590714 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.592468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:07.615724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:07.616676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:07.617578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:07.617578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:07.617578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:07.617578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:07.617814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.617906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.618134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.618397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.619156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:07.619550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.620040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 377/755] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:07.620928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.621096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.635798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 379/756] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:07.641506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.741944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f647d1-785b-4fcf-bbaf-33fbc66f941e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.753621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713fc4b-ab08-4082-9bc6-95f29f2834db None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.777561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.778362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.778738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.779316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.780796 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:07.781084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.782530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.791486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.792495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.792964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.793418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.800747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 380/757] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:07.801668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.802068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.803830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:07.819196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:07.820111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:07.821052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:07.823156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 378/758] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:07.824233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.903172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2d77d-a96b-463d-aeea-90708658fd60 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.936521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3382e2-efed-4968-a187-17a568d9a52e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:07.943489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.944292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.944578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.944860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.953778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.955527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:07.974536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:07.975472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:07.976353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 381/759] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:07.977874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:07.978907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:07.979412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:07.979910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:07.990157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:07.992593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:08.011820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:08.012765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:08.013711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:08.021141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 379/760] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:08.021141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:08.096190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c706c-87b1-41d2-8923-a3ca506427dc None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:08.129324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:08.130301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.130774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.131250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.132193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:08.132672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:08.134234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:08.140171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8103c85d-88ef-40fd-9463-975703ed944e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:08.150044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 382/761] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:08.151160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:08.188820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:08.189581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.189928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.190270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.191149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:08.191525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:08.193018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:08.209490 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 380/762] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:08.210606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:08.257769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afbd92-5547-40e9-8842-ad6f305251f8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:08.294362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:08.295300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.296294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.296723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.297669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:08.298201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:08.299849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:08.312058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 383/763] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:08.313084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:08.317711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a7000-b16f-4494-bd50-cb6170c6b9c8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:08.353083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:08.353820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.354194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.354563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.355525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=b393a07dc5f64481938d72412e27bc02) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:08.355955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:08.357692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:08.371305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 381/764] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:08 2022] GET /identity/v3/role_assignments?user.id=b393a07dc5f64481938d72412e27bc02&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:08.372422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:08.422445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672951ed-6556-4351-a86c-a75dfb62377b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:08.460392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7273e4-1b31-4e00-a94b-b7ac3e7bd885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:08.461603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7273e4-1b31-4e00-a94b-b7ac3e7bd885 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.462039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7273e4-1b31-4e00-a94b-b7ac3e7bd885 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.462490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7273e4-1b31-4e00-a94b-b7ac3e7bd885 None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/dd4bf9aaaae4483bade1570b1c1cfae7/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.464960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7273e4-1b31-4e00-a94b-b7ac3e7bd885 None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=dd4bf9aaaae4483bade1570b1c1cfae7, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:08.466611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7273e4-1b31-4e00-a94b-b7ac3e7bd885 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:08.551249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d49e0-9953-4a28-9743-0b3f90fbc7ad None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:08.590117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 384/765] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:51:08 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/dd4bf9aaaae4483bade1570b1c1cfae7/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:51:08.594565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254cd75-ce6a-4ac4-ae02-5ab284727653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:08.595458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254cd75-ce6a-4ac4-ae02-5ab284727653 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.595789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254cd75-ce6a-4ac4-ae02-5ab284727653 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.596125 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254cd75-ce6a-4ac4-ae02-5ab284727653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.597438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254cd75-ce6a-4ac4-ae02-5ab284727653 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=3616916c10eb4518bef958ead7176455) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:08.597818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254cd75-ce6a-4ac4-ae02-5ab284727653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:08.599732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254cd75-ce6a-4ac4-ae02-5ab284727653 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:08.611260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 382/766] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:08 2022] GET /identity/v3/role_assignments?user.id=3616916c10eb4518bef958ead7176455&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:08.736450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7aa0d-fc64-473e-8d33-82879970f347 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.737152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7aa0d-fc64-473e-8d33-82879970f347 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.737673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c7aa0d-fc64-473e-8d33-82879970f347 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.739370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 385/767] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:08.745567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80a74-e5a1-4cd3-9232-2b203c31ac12 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:08.745867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80a74-e5a1-4cd3-9232-2b203c31ac12 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:08.746132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e80a74-e5a1-4cd3-9232-2b203c31ac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:08.773323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f3e80a74-e5a1-4cd3-9232-2b203c31ac12 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:08.774733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f3e80a74-e5a1-4cd3-9232-2b203c31ac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:08.851026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 383/768] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:08.875754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7aa0d-fc64-473e-8d33-82879970f347 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:08.984924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c7aa0d-fc64-473e-8d33-82879970f347 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:09.031863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:09.033006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:09.033516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:09.033970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:09.034865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:09.036514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:09.050535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:09.051553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:09.052425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:09.054971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 386/769] 10.222.0.49 () {56 vars in 1129 bytes} [Tue May 10 20:51:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:09.060615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e80a74-e5a1-4cd3-9232-2b203c31ac12 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:09.191918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e80a74-e5a1-4cd3-9232-2b203c31ac12 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:09.240728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:09.241648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:09.242106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:09.242529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:09.243425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:09.243876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:09.245403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:09.253712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 384/770] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 20:51:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:09.259195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:09.380488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0b32c-35b0-44e2-9a0c-2e3a67cc6fa1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:09.414907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:09.415607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:09.415889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:09.416164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:09.416883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:09.417191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:09.418551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:09.424310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 387/771] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 20:51:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:09.429975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:09.545120 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9aa94d-30e3-4b7a-8a8a-50d7fad18ebf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:09.587323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13624571-40a4-4aa0-92ed-6f5997217d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:09.587998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624571-40a4-4aa0-92ed-6f5997217d49 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:09.588284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624571-40a4-4aa0-92ed-6f5997217d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:09.588565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13624571-40a4-4aa0-92ed-6f5997217d49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:09.589365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13624571-40a4-4aa0-92ed-6f5997217d49 None admin] RBAC: Adding query filter params (interface=public, service_id=1a9ec8c04f17444ab0cc9c7df7e407bf, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:09.589679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13624571-40a4-4aa0-92ed-6f5997217d49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:09.591059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13624571-40a4-4aa0-92ed-6f5997217d49 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:09.603628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 385/772] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:51:09 2022] GET /identity/v3/endpoints?service_id=1a9ec8c04f17444ab0cc9c7df7e407bf&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:09.611144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:09.721126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193a16c-760d-4ad5-ac5e-4dafafd8a077 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:09.754752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75fba2-ef70-45d0-ae8c-9d17df23aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:09.755455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75fba2-ef70-45d0-ae8c-9d17df23aabb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:09.755742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75fba2-ef70-45d0-ae8c-9d17df23aabb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:09.756017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75fba2-ef70-45d0-ae8c-9d17df23aabb None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:09.756704 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75fba2-ef70-45d0-ae8c-9d17df23aabb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:09.758075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75fba2-ef70-45d0-ae8c-9d17df23aabb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:09.763881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 388/773] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:09 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:10.071935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7187ff-785e-4ce9-9507-38170ab95263 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:10.072347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7187ff-785e-4ce9-9507-38170ab95263 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:10.072527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7187ff-785e-4ce9-9507-38170ab95263 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:10.074132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 386/774] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:10.080300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07c07-3dfd-4a78-98ae-3faed37879eb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:10.080592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07c07-3dfd-4a78-98ae-3faed37879eb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:10.080868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a07c07-3dfd-4a78-98ae-3faed37879eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:10.098685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-96a07c07-3dfd-4a78-98ae-3faed37879eb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:10.099908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-96a07c07-3dfd-4a78-98ae-3faed37879eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:10.181135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 389/775] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:10.213589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7187ff-785e-4ce9-9507-38170ab95263 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:10.344441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7187ff-785e-4ce9-9507-38170ab95263 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:10.397247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:10.398045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:10.398323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:10.398596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] PATH_INFO: `/v3/services/network` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:10.399280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:10.400656 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:10.418710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:10.419761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:10.421195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 387/776] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:10 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:10.426415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07c07-3dfd-4a78-98ae-3faed37879eb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:10.558961 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a07c07-3dfd-4a78-98ae-3faed37879eb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:10.621739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:10.622414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:10.622697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:10.622975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:10.624360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] RBAC: Adding query filter params (name=network) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:10.624667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:10.626194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:10.635411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 390/777] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:10.641021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:10.777987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f710e7-3b66-4dbb-a631-b1bceb59242a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:10.822786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:10.823480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:10.823761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:10.824035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:10.824750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] RBAC: Adding query filter params (type=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:10.825056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:10.826433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:10.835310 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 388/778] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:10.841410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.079886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644a532-5e69-4ad9-aa5c-c253abe3e802 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:11.118159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa012d2-ed9d-4674-a8d4-e2ee39d0b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:11.118829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa012d2-ed9d-4674-a8d4-e2ee39d0b77e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.119109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa012d2-ed9d-4674-a8d4-e2ee39d0b77e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.119400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa012d2-ed9d-4674-a8d4-e2ee39d0b77e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.120197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa012d2-ed9d-4674-a8d4-e2ee39d0b77e None admin] RBAC: Adding query filter params (interface=public, service_id=0bb6ba98cd7c44168326e842b74ace74, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:11.120505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa012d2-ed9d-4674-a8d4-e2ee39d0b77e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:11.121882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa012d2-ed9d-4674-a8d4-e2ee39d0b77e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:11.131800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 391/779] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:51:10 2022] GET /identity/v3/endpoints?service_id=0bb6ba98cd7c44168326e842b74ace74&interface=public®ion_id=RegionOne => generated 194 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:11.137473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.187011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2477-478f-4a89-af57-9aa8a3516258 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.187878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2477-478f-4a89-af57-9aa8a3516258 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.188369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf2477-478f-4a89-af57-9aa8a3516258 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.190198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 392/780] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:11.195889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d57520-bd3e-47c1-8242-bc7187cb13c2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.196472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d57520-bd3e-47c1-8242-bc7187cb13c2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.196955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d57520-bd3e-47c1-8242-bc7187cb13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.219303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-94d57520-bd3e-47c1-8242-bc7187cb13c2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:11.221513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-94d57520-bd3e-47c1-8242-bc7187cb13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:11.294334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125467a-04e5-4638-902e-09c732d564bc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:11.351473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 393/781] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:11.366955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abfd2b-1599-4783-bf6c-44fa530adb45 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.367730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abfd2b-1599-4783-bf6c-44fa530adb45 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.368205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:11.368497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abfd2b-1599-4783-bf6c-44fa530adb45 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.368914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.369195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.369465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.370199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:11.371214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 394/782] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:11.372650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:11.382299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3061-6be3-46c8-8e73-5176c7bba9f3 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.382903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3061-6be3-46c8-8e73-5176c7bba9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.383247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 389/783] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/services => generated 772 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:11.383679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df3061-6be3-46c8-8e73-5176c7bba9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.413806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.415104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-49df3061-6be3-46c8-8e73-5176c7bba9f3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:11.416666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-49df3061-6be3-46c8-8e73-5176c7bba9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:11.488627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 395/784] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:11.496759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb2675-5614-4db1-ac11-e161043f0809 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.497394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb2675-5614-4db1-ac11-e161043f0809 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.497910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb2675-5614-4db1-ac11-e161043f0809 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.500870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 396/785] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:11.506184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e9ff-0b04-4502-8224-8aae50a35e15 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.506727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e9ff-0b04-4502-8224-8aae50a35e15 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.507256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3e9ff-0b04-4502-8224-8aae50a35e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.535713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c3f3e9ff-0b04-4502-8224-8aae50a35e15 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:11.537286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c3f3e9ff-0b04-4502-8224-8aae50a35e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:11.553880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1fb39-e0f7-4123-8b52-756fc257ac06 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:11.591296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:11.592110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.592436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.592713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.604719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:11.612666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:11.613689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 390/786] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:11.616992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.627178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 397/787] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:11.627178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e9ff-0b04-4502-8224-8aae50a35e15 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.739337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3e9ff-0b04-4502-8224-8aae50a35e15 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:11.750708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0358a-224c-4115-a025-ae9ef8aa5975 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:11.774558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:11.775258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.775542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.775812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.776563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:11.776866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:11.778334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:11.785502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:11.786360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.786645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.786976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.787982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 398/788] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:11.788830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.798674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:11.806974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:11.807961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:11.808823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 391/789] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:11.809532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.889779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d083be1-2550-4f73-af3e-3f5de7a46db3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:11.913472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfbc70-ebad-4693-b9ff-441fed97f943 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:11.923604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:11.924399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.924682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.924957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.934973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:11.942678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:11.944920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 399/790] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:11.946932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:11.955155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:11.955155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:11.955155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:11.955155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:11.962519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:11.964004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:11.982019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:11.984898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:11.987050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:11.987050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:11.987050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:11.987050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:11.987050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 392/791] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:11.987050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.048326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbd663-79a2-4995-bf1e-a9b3d3b87a21 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.082968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.083664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.084070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.084357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.085105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:12.085407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.087210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.087996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd471dd-16a1-4133-bc57-1fc548def94e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.096755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 400/792] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:12.097598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.124419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.125082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.125414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.125689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.126430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:12.126785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.128192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.137049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 393/793] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:12.137999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.198857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714dfd1-cf70-491b-9ca1-795fb31e5371 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.234152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.235093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.235419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.235696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.236919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:12.237224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.238881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.239725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf8052-a084-4ce4-992f-6a29e166fea0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.254031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 401/794] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:12.255132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.287252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.288097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.288526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.288861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.304009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.305772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:12.329698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:12.330939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:12.332783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:12.332783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:12.332783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:12.332783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:12.332783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 394/795] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:12.332783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.357289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bde9a-947b-42de-875f-9f8eb32e19e6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.394407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.395391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.395770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.396142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.407041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.408773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:12.426947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:12.428710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:12.430816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:12.430816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:12.430816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:12.430816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:12.430816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 402/796] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:12.430816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.453498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8f04e-16bc-4241-aecf-68e1bc1465e2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.487196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.488173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.488549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.488922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.496518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.498061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:12.512859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:12.515068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 395/797] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:12.517299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.551609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ac2a0-27af-4aa6-a523-20b6bd78e093 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.593605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.595084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.595399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.595676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.596412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:12.596876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.600054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.621137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 403/798] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:12.622373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.632416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1def6e-717f-42b2-8f64-56e1f4ccdb56 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.673324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.674402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.674884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.675401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.676361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:12.676864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.678904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.695198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 396/799] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:12.697360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.741432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae694808-f066-4c41-8fa8-48792f3de705 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.775759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.776487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.776773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.777047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.777893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:12.778198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.779647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.798890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 404/800] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:12.800104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.806049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3bd6f-e4d2-41ae-8ad4-1b4e1de774f2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.841571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.842474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.842919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.843406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.850501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.851981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:12.867255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:12.868394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:12.869574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:12.871524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 397/801] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:12.872454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.899278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa40e6-6933-4aff-a8fb-f27e41f3fd0e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:12.933093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad17c3-a8c4-4316-b237-7dadea6fed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:12.933885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad17c3-a8c4-4316-b237-7dadea6fed38 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.934174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad17c3-a8c4-4316-b237-7dadea6fed38 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.934448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad17c3-a8c4-4316-b237-7dadea6fed38 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.941686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad17c3-a8c4-4316-b237-7dadea6fed38 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:12.943115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad17c3-a8c4-4316-b237-7dadea6fed38 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-93ad17c3-a8c4-4316-b237-7dadea6fed38 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:12.957546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:12.958671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:12.959697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 405/802] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:12.960399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467c30-34ae-4143-8871-8e107095b69c None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:12.960685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467c30-34ae-4143-8871-8e107095b69c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:12.960962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c467c30-34ae-4143-8871-8e107095b69c None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:12.966328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 406/803] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:12.967088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467c30-34ae-4143-8871-8e107095b69c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:12.986060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9953415-d8a6-4ba8-9840-226bf8c1270f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.021361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c3443-b354-486f-8dcc-b4796c0fd8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.022085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3443-b354-486f-8dcc-b4796c0fd8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.022369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3443-b354-486f-8dcc-b4796c0fd8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.022645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c3443-b354-486f-8dcc-b4796c0fd8d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.033591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c3443-b354-486f-8dcc-b4796c0fd8d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.035017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c3443-b354-486f-8dcc-b4796c0fd8d5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-052c3443-b354-486f-8dcc-b4796c0fd8d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:13.054461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:13.055438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:13.056334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:13.056334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:13.056334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:13.056334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:13.056334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 398/804] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:13.057096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa54a-3db4-4c16-839a-92da63b63d5f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.057096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa54a-3db4-4c16-839a-92da63b63d5f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.057690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461aa54a-3db4-4c16-839a-92da63b63d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.072694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c467c30-34ae-4143-8871-8e107095b69c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.073117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-461aa54a-3db4-4c16-839a-92da63b63d5f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:13.074286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-461aa54a-3db4-4c16-839a-92da63b63d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:13.106605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.107301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.107587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.107879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.109309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:13.109612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.111150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.127741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 407/805] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 20:51:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:13.127741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.145038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 399/806] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:13.152285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa54a-3db4-4c16-839a-92da63b63d5f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.227679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c35cdc5-5986-4005-a840-27a3d74a003d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.251987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461aa54a-3db4-4c16-839a-92da63b63d5f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.260481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.261156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.261436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.261711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.262560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:13.262863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.264853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.285827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 408/807] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:13.285827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.290331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.291048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.291375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.291648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.292429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:13.292733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.294131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.306523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 400/808] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:13.307286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.383444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f893867-891f-40e3-a02c-c30115b99a1d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.408187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a5577-58d2-4817-baf8-65f55dbe1c7a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.424325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.425548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.425834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.426105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.436687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.438130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.441652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.442466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.442748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.443025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.443713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.445084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:13.456566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:13.457451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:13.458355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:13.458355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:13.458355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:13.458355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:13.458588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:13.459480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 10 20:51:13.460325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:13.462566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 409/809] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:13.463404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 401/810] 10.222.0.49 () {56 vars in 1129 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:13.463570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.464739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.562029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe47a1-f74b-45bd-a1b1-6612ba85ebd9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.562237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2f9e9-138c-4e0a-beae-420e094f267c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.595490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.595830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.596141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.596420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.596530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.596687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.596780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.597033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.611505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.612962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:13.627916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:13.629089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:13.630026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:13.634232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 402/811] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:13.635022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.668170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.669612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.739365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205dd9d7-65cd-4dcf-b905-6d61c819d8f2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.773860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.774524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.774896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.775200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.775924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:13.776233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.777621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.783110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 410/812] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:13.783110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.798816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 403/813] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:13.798816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.883442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374559a-49d8-4993-acae-a90c1b416386 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.891717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fec7a5-1086-46be-888a-7c6c0836578f None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:13.916363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.917022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.917303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.917576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.918283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:13.918588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.919972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.924435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:13.925090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:13.925376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:13.925633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 411/814] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:13.925741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:13.926436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:13.926536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:13.926819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:13.928209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:13.940314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 404/815] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:13.941121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.021509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a3cd-1bed-4959-9c0e-e4eda98ff1b3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.038819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cef708-7f4c-4b13-85e6-3fd94a55428d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.052994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa9e63-9bbb-462b-b0b6-45746c498864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.053777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa9e63-9bbb-462b-b0b6-45746c498864 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.054055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa9e63-9bbb-462b-b0b6-45746c498864 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.054323 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa9e63-9bbb-462b-b0b6-45746c498864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.064324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa9e63-9bbb-462b-b0b6-45746c498864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.065744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa9e63-9bbb-462b-b0b6-45746c498864 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.071913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.072698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.072983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.073259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.079915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.081341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e7aa9e63-9bbb-462b-b0b6-45746c498864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:14.082861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:14.083912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:14.084819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:14.084819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:14.084819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:14.084819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:14.084819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 412/816] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:14.085604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5eb45-5e14-4a2b-8e5d-56f5cb0a48ae None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.085604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5eb45-5e14-4a2b-8e5d-56f5cb0a48ae None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.085729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf5eb45-5e14-4a2b-8e5d-56f5cb0a48ae None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.091241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 413/817] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:14.091241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5eb45-5e14-4a2b-8e5d-56f5cb0a48ae None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:14.095040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:14.096249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 405/818] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:14.097466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.187499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf5eb45-5e14-4a2b-8e5d-56f5cb0a48ae None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.193770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d9c93-0414-4247-85cb-d509faf265c4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.218993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.219675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.219958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.220230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.220940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:14.221241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.222602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.226095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483d9fe-296f-4eac-91a1-e5ed34ebd9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.226966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d9fe-296f-4eac-91a1-e5ed34ebd9af None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.227238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 414/819] 10.222.0.49 () {56 vars in 1124 bytes} [Tue May 10 20:51:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:14.227348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d9fe-296f-4eac-91a1-e5ed34ebd9af None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.227540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483d9fe-296f-4eac-91a1-e5ed34ebd9af None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/b393a07dc5f64481938d72412e27bc02/roles/bd48cc77ef9847008cb25340f9c96405` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.228010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.243143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483d9fe-296f-4eac-91a1-e5ed34ebd9af None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=b393a07dc5f64481938d72412e27bc02, role_id=bd48cc77ef9847008cb25340f9c96405)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.244587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483d9fe-296f-4eac-91a1-e5ed34ebd9af None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.323400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564db284-3081-42d1-8b88-afcb1bc4309f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.354819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.355484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.355768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.356040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.356751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:14.357052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.358953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.368915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 406/820] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:51:14 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/b393a07dc5f64481938d72412e27bc02/roles/bd48cc77ef9847008cb25340f9c96405 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:51:14.369662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 415/821] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:14.370259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.370461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3feca0-c9eb-449e-94f0-6bb5aea4e168 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.370777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3feca0-c9eb-449e-94f0-6bb5aea4e168 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.371076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3feca0-c9eb-449e-94f0-6bb5aea4e168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.393122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9e3feca0-c9eb-449e-94f0-6bb5aea4e168 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:14.394361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9e3feca0-c9eb-449e-94f0-6bb5aea4e168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:14.469123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 407/822] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:14.470772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3feca0-c9eb-449e-94f0-6bb5aea4e168 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.481904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b64dab-95f7-4ad6-acfd-31b2f9c62ada None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.517673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.518344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.518626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.518899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.519731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:14.520036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.521467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.534859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 416/823] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:14.535790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.595895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3feca0-c9eb-449e-94f0-6bb5aea4e168 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.630349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.631018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.631346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.631674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.632420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.633800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.651413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e287f9-1f79-42aa-955a-bc44212175ef None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.685175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.685993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.686278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.686559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.693173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.694636 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:14.708075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:14.709140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 417/824] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:14.710082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.735507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 408/825] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:14.735507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.836396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c182620-6605-4e51-9838-5c720a9db003 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.860172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f5bed-4bef-4210-a3ae-aab468e81660 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:14.881578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.882954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.882954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.883198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] PATH_INFO: `/v3/services/network` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.883705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.885113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:14.898843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:14.900167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 10 20:51:14.901158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:14.902631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:14.904079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:14.904560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:14.905095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/3616916c10eb4518bef958ead7176455/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:14.905894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 418/826] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:14 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:14.906854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:14.907902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=3616916c10eb4518bef958ead7176455, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:14.909558 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:14.975845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 409/827] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:51:14 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/3616916c10eb4518bef958ead7176455/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:51:14.977034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:15.020227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a40751-99de-40d8-8010-cf8267a29f17 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:15.057554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:15.058240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:15.058526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:15.058810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:15.059924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:15.060049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:15.062323 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:15.081069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 419/828] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:15.082473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:15.094466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b794b4-e121-4a75-8c0a-f26d5f409b2e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:15.132069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:15.133130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:15.133619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:15.134120 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:15.135046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] RBAC: Adding query filter params (name=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:15.135595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:15.137209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:15.142989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 410/829] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:15.148777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:15.202124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9689d91-ea90-4436-98af-16d6c8090312 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:15.240761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:15.241424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:15.242097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:15.242375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:15.243588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=dd4bf9aaaae4483bade1570b1c1cfae7) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:15.244207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:15.245822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:15.255220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 420/830] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:15 2022] GET /identity/v3/role_assignments?user.id=dd4bf9aaaae4483bade1570b1c1cfae7&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:15.282174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161e2d7-a13e-4228-b997-63cd6ddb4eff None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:15.339885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810023dc-766b-4498-a9dc-075ec9e03f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:15.340637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810023dc-766b-4498-a9dc-075ec9e03f1f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:15.340925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810023dc-766b-4498-a9dc-075ec9e03f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:15.341201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810023dc-766b-4498-a9dc-075ec9e03f1f None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:15.341926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810023dc-766b-4498-a9dc-075ec9e03f1f None admin] RBAC: Adding query filter params (type=network) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:15.342261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810023dc-766b-4498-a9dc-075ec9e03f1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:15.344066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810023dc-766b-4498-a9dc-075ec9e03f1f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:15.355314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 411/831] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:15 2022] GET /identity/v3/services?type=network => generated 350 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:15.360980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:15.478311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93904d-8005-4d04-96df-546bee56884d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:15.514042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695635b-6afa-4ffd-89c4-e6d1dd4fdd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:15.515343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695635b-6afa-4ffd-89c4-e6d1dd4fdd85 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:15.515620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695635b-6afa-4ffd-89c4-e6d1dd4fdd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:15.515888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695635b-6afa-4ffd-89c4-e6d1dd4fdd85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:15.516644 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695635b-6afa-4ffd-89c4-e6d1dd4fdd85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:15.517996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695635b-6afa-4ffd-89c4-e6d1dd4fdd85 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:15.640620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 421/832] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:16.729428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f196c-a06f-4065-826a-188333e5164a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:16.729939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f196c-a06f-4065-826a-188333e5164a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:16.730017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f196c-a06f-4065-826a-188333e5164a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:16.731689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 412/833] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:16.737787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329909-7a13-472d-b5b7-ca7b74aed25a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:16.738292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329909-7a13-472d-b5b7-ca7b74aed25a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:16.738465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329909-7a13-472d-b5b7-ca7b74aed25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:16.756196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a3329909-7a13-472d-b5b7-ca7b74aed25a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:16.757379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a3329909-7a13-472d-b5b7-ca7b74aed25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:16.831082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 422/834] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:16.854270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f196c-a06f-4065-826a-188333e5164a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:16.961799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f196c-a06f-4065-826a-188333e5164a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:16.996364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:16.997163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:16.997447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:16.997725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.009816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:17.018137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:17.020311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:17.022274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 413/835] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:17.027144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3329909-7a13-472d-b5b7-ca7b74aed25a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.128901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3329909-7a13-472d-b5b7-ca7b74aed25a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.166837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be90b0b-7c76-473b-b920-91790ec6914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.167540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be90b0b-7c76-473b-b920-91790ec6914f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.167820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be90b0b-7c76-473b-b920-91790ec6914f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.168092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be90b0b-7c76-473b-b920-91790ec6914f None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.168846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be90b0b-7c76-473b-b920-91790ec6914f None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:17.169151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be90b0b-7c76-473b-b920-91790ec6914f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.171372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be90b0b-7c76-473b-b920-91790ec6914f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.180572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 423/836] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:17.185971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.288429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5aa7-aa30-4750-b1fa-a22f6ceb7f2d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.320763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc8ff-dcbd-4790-a622-b6f84a498f38 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.321088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc8ff-dcbd-4790-a622-b6f84a498f38 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.321474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc8ff-dcbd-4790-a622-b6f84a498f38 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.323661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 424/837] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:17.328549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.329297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97bb8a-8863-4bbd-9b40-d265b25cb0c2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.329587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97bb8a-8863-4bbd-9b40-d265b25cb0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.329867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97bb8a-8863-4bbd-9b40-d265b25cb0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.330268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.330753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.331253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.342262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.345465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.348347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9e97bb8a-8863-4bbd-9b40-d265b25cb0c2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:17.349535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9e97bb8a-8863-4bbd-9b40-d265b25cb0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:17.364612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:17.365575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:17.366507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:17.366507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:17.366507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:17.366507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:17.368861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 414/838] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:17.376330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.423436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 425/839] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:17.441326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97bb8a-8863-4bbd-9b40-d265b25cb0c2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.477385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fccc63-c2a8-4d7c-9039-6d85593da440 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.515447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.516401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.516835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.517265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.518140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:17.518610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.520197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.533628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 415/840] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:17.542846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.546816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97bb8a-8863-4bbd-9b40-d265b25cb0c2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.582608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.583469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.583754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.584028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.584703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.586104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:17.599686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:17.600862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:17.601737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 426/841] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:17.610359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.659696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf8134-5421-495b-9437-2935b8414c02 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.695077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676e7a1-39d6-49e3-93bd-6d91be70d9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.695922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e7a1-39d6-49e3-93bd-6d91be70d9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.696206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e7a1-39d6-49e3-93bd-6d91be70d9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.696478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676e7a1-39d6-49e3-93bd-6d91be70d9c3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.704429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676e7a1-39d6-49e3-93bd-6d91be70d9c3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.705894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676e7a1-39d6-49e3-93bd-6d91be70d9c3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.716171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04bc45-9753-400f-a408-b4658dccb80c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c676e7a1-39d6-49e3-93bd-6d91be70d9c3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:17.721748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:17.722704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:17.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 416/842] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:17.724680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cd665-947c-4cc3-8699-b306aa9ef0d8 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.724680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cd665-947c-4cc3-8699-b306aa9ef0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.724815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cd665-947c-4cc3-8699-b306aa9ef0d8 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.726064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 417/843] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:17.729789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cd665-947c-4cc3-8699-b306aa9ef0d8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.758371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c18603-0a8d-4150-86f9-f1d0f0fea705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.759066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18603-0a8d-4150-86f9-f1d0f0fea705 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.759343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18603-0a8d-4150-86f9-f1d0f0fea705 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.759629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c18603-0a8d-4150-86f9-f1d0f0fea705 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.760373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c18603-0a8d-4150-86f9-f1d0f0fea705 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:17.760679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c18603-0a8d-4150-86f9-f1d0f0fea705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.762039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c18603-0a8d-4150-86f9-f1d0f0fea705 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.767259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 427/844] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:17.772618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad021-417f-4066-989c-a54f5dbd36fa None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.774656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad021-417f-4066-989c-a54f5dbd36fa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.774656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ad021-417f-4066-989c-a54f5dbd36fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.791332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bf0ad021-417f-4066-989c-a54f5dbd36fa None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:17.792532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bf0ad021-417f-4066-989c-a54f5dbd36fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:17.837680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cd665-947c-4cc3-8699-b306aa9ef0d8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.856752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 428/845] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:17.857586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ad021-417f-4066-989c-a54f5dbd36fa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.884690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb22adf-8c49-4d8d-a714-430dd51d4504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.885427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22adf-8c49-4d8d-a714-430dd51d4504 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.885714 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22adf-8c49-4d8d-a714-430dd51d4504 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.885993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb22adf-8c49-4d8d-a714-430dd51d4504 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.886839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22adf-8c49-4d8d-a714-430dd51d4504 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:17.887177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22adf-8c49-4d8d-a714-430dd51d4504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.888622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb22adf-8c49-4d8d-a714-430dd51d4504 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.906427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 418/846] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:17.907783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e142fc-78e4-4ae7-8540-75ae2ea3a222 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.908410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e142fc-78e4-4ae7-8540-75ae2ea3a222 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.908410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e142fc-78e4-4ae7-8540-75ae2ea3a222 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.909550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 419/847] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:17.911712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e142fc-78e4-4ae7-8540-75ae2ea3a222 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:17.952871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ad021-417f-4066-989c-a54f5dbd36fa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:17.984711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:17.985369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:17.985650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:17.985925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:17.986628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:17.986930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:17.988392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:17.992622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 429/848] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:17.993384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.009384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e142fc-78e4-4ae7-8540-75ae2ea3a222 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.047350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfefd4-0530-4609-8ab6-24c881c2ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.048172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfefd4-0530-4609-8ab6-24c881c2ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.048460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfefd4-0530-4609-8ab6-24c881c2ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.048739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfefd4-0530-4609-8ab6-24c881c2ddfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.062511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfefd4-0530-4609-8ab6-24c881c2ddfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-e8dfefd4-0530-4609-8ab6-24c881c2ddfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:18.072281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:18.073342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:18.074204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:18.075745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 420/849] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:18.077694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977460b-1a3d-44ae-806c-f6df2ef394fc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.078013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977460b-1a3d-44ae-806c-f6df2ef394fc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.078261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977460b-1a3d-44ae-806c-f6df2ef394fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.096629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8977460b-1a3d-44ae-806c-f6df2ef394fc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:18.097771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8977460b-1a3d-44ae-806c-f6df2ef394fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:18.104496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1262c-0bc2-4ab8-be0b-64989cd3703d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.140251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.140985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.141266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.141546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.171248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 421/850] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:18.172404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977460b-1a3d-44ae-806c-f6df2ef394fc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.221691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.223170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.292808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977460b-1a3d-44ae-806c-f6df2ef394fc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.321951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 430/851] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:18.321951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.335298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.336148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.336601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.336882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.338006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:18.338612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.340455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.350419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 422/852] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:18.351198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.428126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b31b0-ab39-4982-b666-d6a7c16b34bf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.454392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314de1-0c10-49a7-9a71-0c11af63e492 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.461506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.462321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.462603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.462884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.463577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.464944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:18.478391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:18.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:18.480528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 431/853] 10.222.0.49 () {56 vars in 1132 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:18.481375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.499281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.500240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.500529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.501112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.514784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.516384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:18.533944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:18.534888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:18.535842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:18.535842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:18.535842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:18.535842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:18.539754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 423/854] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:18.540465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.583952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d5664-1c6d-4772-b3e8-1b92de04419a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.620485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.621280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.621563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.621839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.633596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.635030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.646601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f74f0a-bce9-4736-97a2-6b6f0f1b92c1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:18.651866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:18.652763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:18.653677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:18.653677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:18.653677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:18.653677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:18.653677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 432/855] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:18.654370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.683255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.683922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.684242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.684476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.685186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:18.685494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.686998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.691897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 424/856] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:18.693017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.757828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb414cc-1970-4323-984b-5ade0a406e45 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.793409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.794185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.794354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.794627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.796197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:18.796505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.798053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.798943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdf01-c8c6-47fe-a904-b49f374d80e6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.809912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 433/857] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:18.811149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.835688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.836429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.836707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.836993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.837718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:18.838027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.839438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.855945 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 425/858] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:18.855945 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:18.912338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b939a-3f95-46a6-868f-7c4a4aa0fac9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.945769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:18.946434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:18.946721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:18.947007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:18.947757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:18.948067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:18.949437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:18.949992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16d2e5-eaf2-4afe-b4f2-78eccfe20435 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:18.963156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 434/859] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:18.963156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:19.005518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:19.006326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:19.006605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:19.006875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:19.016977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:19.018798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:19.040692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:19.041683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:19.042590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:19.047429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 426/860] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:19.050527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:19.077696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7486294-737f-48ff-bad4-b55d02fdc08e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:19.115138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:19.115987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:19.116341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:19.116689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:19.125382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:19.127051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:19.149182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:19.151417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:19.153450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 435/861] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:19.160625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:19.187170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10d1036-db93-445a-a7cd-ed9a6eedf1cf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:19.230043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:19.231166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:19.231903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:19.232613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:19.234361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:19.234826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:19.237183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:19.258885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 427/862] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:19.260634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:19.275898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd8a06-86f5-4eb2-83b8-3436e7ae14ee None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:19.310943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:19.311716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:19.312000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:19.312270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:19.313113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:19.313419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:19.314839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:19.337278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 436/863] 10.222.0.49 () {56 vars in 1135 bytes} [Tue May 10 20:51:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:19.338487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:19.384873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3f38-ba05-4549-996c-0d43a6167d23 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:19.418627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:19.419321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:19.419604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:19.419880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:19.421698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=b393a07dc5f64481938d72412e27bc02) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:19.421977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:19.423434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:19.435161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 428/864] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:19 2022] GET /identity/v3/role_assignments?user.id=b393a07dc5f64481938d72412e27bc02&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:19.473231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86687ccd-5733-42c7-943e-782bdeebe4ae None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:19.510531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:19.511232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:19.511527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:19.511805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:19.585188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:19.586734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:19.693942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 437/865] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:19 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:19.699531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:19.806082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4566f5-b510-4cf5-9eb4-41b2f48da543 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:19.839956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:19.840749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:19.841028 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:19.841301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:19.853605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:19.855058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:19.872268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:19.873224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:19.875423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:19.875423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:19.875423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:19.875423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:19.875423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 429/866] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:19.881738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:19.981433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1cec0-8c1e-44bd-9ed5-7e880f4acee3 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:20.019852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:20.020878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:20.021389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:20.021885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:20.022807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:20.023341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:20.024904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:20.037165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 438/867] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:20.043051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:20.153312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adacda1-3ec1-4c11-a7fd-e77c5a36b685 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:20.188706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285bd05-9892-4344-91ff-8e14ce0ae61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:20.189506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285bd05-9892-4344-91ff-8e14ce0ae61a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:20.189791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285bd05-9892-4344-91ff-8e14ce0ae61a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:20.190069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285bd05-9892-4344-91ff-8e14ce0ae61a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:20.197689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285bd05-9892-4344-91ff-8e14ce0ae61a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:20.199276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285bd05-9892-4344-91ff-8e14ce0ae61a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b285bd05-9892-4344-91ff-8e14ce0ae61a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:20.215143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:20.216156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:20.217090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 430/868] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:20.224659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:20.277779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927984a-3917-4e66-94d2-865b305f3e07 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:20.277973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927984a-3917-4e66-94d2-865b305f3e07 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:20.278289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927984a-3917-4e66-94d2-865b305f3e07 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:20.279994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 431/869] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:20.285111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8a03-2c55-4ed7-b682-53c04f3f99ce None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:20.285394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8a03-2c55-4ed7-b682-53c04f3f99ce None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:20.285672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c8a03-2c55-4ed7-b682-53c04f3f99ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:20.308180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5c5c8a03-2c55-4ed7-b682-53c04f3f99ce None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:20.309402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c5c8a03-2c55-4ed7-b682-53c04f3f99ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:20.344267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4f14a-8afd-4c12-9d4f-f8149912ecc5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:20.380213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:20.380881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:20.381164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:20.381441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:20.382305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:20.382620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:20.384074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:20.392701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 432/870] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:20.397649 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 439/871] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:20.403508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c8a03-2c55-4ed7-b682-53c04f3f99ce None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:20.413533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:20.520395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1aad-74bd-40a9-92c5-2e58256dc8ec None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:20.524228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c8a03-2c55-4ed7-b682-53c04f3f99ce None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:20.558703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1019d8-94e8-4d2c-a0d8-e9b8c53bb454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:20.559570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1019d8-94e8-4d2c-a0d8-e9b8c53bb454 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:20.559856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1019d8-94e8-4d2c-a0d8-e9b8c53bb454 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:20.560133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1019d8-94e8-4d2c-a0d8-e9b8c53bb454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:20.562106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1019d8-94e8-4d2c-a0d8-e9b8c53bb454 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=3616916c10eb4518bef958ead7176455) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:20.562351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d553-ca62-4842-8878-129342a9f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:20.562544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1019d8-94e8-4d2c-a0d8-e9b8c53bb454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:20.563169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d553-ca62-4842-8878-129342a9f365 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:20.563533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d553-ca62-4842-8878-129342a9f365 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:20.563884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d553-ca62-4842-8878-129342a9f365 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:20.564056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1019d8-94e8-4d2c-a0d8-e9b8c53bb454 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:20.564751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d553-ca62-4842-8878-129342a9f365 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:20.566351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3d553-ca62-4842-8878-129342a9f365 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:20.574046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 433/872] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:20 2022] GET /identity/v3/role_assignments?user.id=3616916c10eb4518bef958ead7176455&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:20.645601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 440/873] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:20 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:51:21.359577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda7313-cdfd-4a1e-bdf0-d1bc8c19b4d4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:21.360134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda7313-cdfd-4a1e-bdf0-d1bc8c19b4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:21.360134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbda7313-cdfd-4a1e-bdf0-d1bc8c19b4d4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:21.361710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 434/874] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:21.367306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772016a-7162-44d7-a0ed-f95ef634fc9c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:21.367784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772016a-7162-44d7-a0ed-f95ef634fc9c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:21.367866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772016a-7162-44d7-a0ed-f95ef634fc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:21.385495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4772016a-7162-44d7-a0ed-f95ef634fc9c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:21.386700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4772016a-7162-44d7-a0ed-f95ef634fc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:21.461001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 441/875] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:21 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:21.484297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda7313-cdfd-4a1e-bdf0-d1bc8c19b4d4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:21.589432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbda7313-cdfd-4a1e-bdf0-d1bc8c19b4d4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:21.624098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb85246-d05e-4481-8f39-4628d2613edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:21.624699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85246-d05e-4481-8f39-4628d2613edb None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:21.624984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85246-d05e-4481-8f39-4628d2613edb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:21.625258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb85246-d05e-4481-8f39-4628d2613edb None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:21.625993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb85246-d05e-4481-8f39-4628d2613edb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:21.627390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb85246-d05e-4481-8f39-4628d2613edb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:21.713873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 435/876] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:21 2022] POST /identity/v3/services => generated 269 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:21.894586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38990-7fcc-4a42-848b-108af7e1f988 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:21.895315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38990-7fcc-4a42-848b-108af7e1f988 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:21.895845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f38990-7fcc-4a42-848b-108af7e1f988 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:21.897701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 442/877] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:21.903432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242858-e9db-4f5b-a852-141608198ba8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:21.904000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242858-e9db-4f5b-a852-141608198ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:21.904499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242858-e9db-4f5b-a852-141608198ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:21.924064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6e242858-e9db-4f5b-a852-141608198ba8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:21.925612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e242858-e9db-4f5b-a852-141608198ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:21.999548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 436/878] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:22.022765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38990-7fcc-4a42-848b-108af7e1f988 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:22.130859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f38990-7fcc-4a42-848b-108af7e1f988 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:22.167469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:22.168206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:22.168546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:22.168829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:22.180215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:22.188536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:22.189551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:22.190492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 443/879] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 20:51:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:22.197596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e242858-e9db-4f5b-a852-141608198ba8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:22.301191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e242858-e9db-4f5b-a852-141608198ba8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:22.337217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:22.338068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:22.338351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:22.338621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:22.339385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:22.339691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:22.341202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:22.350308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 437/880] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 20:51:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:22.356592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:22.459311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dced02-3af6-441e-9a88-2de91e761d58 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:22.499377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:22.500600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:22.501115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:22.501612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:22.513529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:22.515445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:22.532992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:22.533960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:22.534865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:22.534865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:22.534865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:22.534865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:22.537151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 444/881] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:22.543112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:22.651248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcac5a2-fa58-4354-b541-5ef22181f8c1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:22.686817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:22.687507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:22.687784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:22.688060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:22.688773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:22.689076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:22.690440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:22.702436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 438/882] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:22.707982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:22.823495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1aea3e-50a8-405d-a7de-047dbbcb8355 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:22.857450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d1a89-5fe4-4db5-a741-4a3cd90df00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:22.858345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1a89-5fe4-4db5-a741-4a3cd90df00e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:22.858639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1a89-5fe4-4db5-a741-4a3cd90df00e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:22.858930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d1a89-5fe4-4db5-a741-4a3cd90df00e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:22.866818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d1a89-5fe4-4db5-a741-4a3cd90df00e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:22.868371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d1a89-5fe4-4db5-a741-4a3cd90df00e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-4d7d1a89-5fe4-4db5-a741-4a3cd90df00e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:22.883531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:22.884525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:22.885528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 445/883] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:51:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:22.893061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:22.965280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e04bc-a611-4860-bb02-78e7d78908c3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:22.965658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e04bc-a611-4860-bb02-78e7d78908c3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:22.965831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e04bc-a611-4860-bb02-78e7d78908c3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:22.972716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 446/884] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:22.974736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d516b-716e-41de-b302-4982a9244c4d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:22.975027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d516b-716e-41de-b302-4982a9244c4d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:22.975337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d516b-716e-41de-b302-4982a9244c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:22.992087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d94d516b-716e-41de-b302-4982a9244c4d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:22.993286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d94d516b-716e-41de-b302-4982a9244c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:22.998000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0d161-e77e-4ff8-a8db-a71a8746a711 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.035710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2c76a-240d-42dd-8914-5c9681a16c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.036541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c76a-240d-42dd-8914-5c9681a16c7c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.036725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c76a-240d-42dd-8914-5c9681a16c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.036950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2c76a-240d-42dd-8914-5c9681a16c7c None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.037832 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c76a-240d-42dd-8914-5c9681a16c7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:23.038082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c76a-240d-42dd-8914-5c9681a16c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.039551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2c76a-240d-42dd-8914-5c9681a16c7c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.063381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 447/885] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:23.063381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8933-e65c-4c71-a8db-53ffd51d43a8 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.063381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8933-e65c-4c71-a8db-53ffd51d43a8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.063381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a8933-e65c-4c71-a8db-53ffd51d43a8 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.064088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 448/886] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:23.064390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 439/887] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 20:51:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:23.065074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8933-e65c-4c71-a8db-53ffd51d43a8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.069121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e32a-2528-4039-a0ff-7042930cf079 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.069416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e32a-2528-4039-a0ff-7042930cf079 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.069703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19e32a-2528-4039-a0ff-7042930cf079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.091020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-be19e32a-2528-4039-a0ff-7042930cf079 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:23.092867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-be19e32a-2528-4039-a0ff-7042930cf079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:23.160297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 440/888] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:23.161039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e32a-2528-4039-a0ff-7042930cf079 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.181766 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a8933-e65c-4c71-a8db-53ffd51d43a8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.220475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.221125 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.221406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.221675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.259463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19e32a-2528-4039-a0ff-7042930cf079 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.287443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.289143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.293805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.294600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.294886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.295968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.296724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.298114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:23.309890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:23.311043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:23.312138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 441/889] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:23.313600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.393813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 449/890] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:23.395050 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.418965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a4b676-7372-4f8a-ae19-f36921da8d88 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.453808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.454607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.454886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.455180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.455831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.457203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:23.469422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:23.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:23.471414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:23.475445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 442/891] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:23.476491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.502596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b1692-4811-4a51-bafb-2abbe2e2a8d6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.537530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.538193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.538476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.538757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.539501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:23.539807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.541169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.547441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 450/892] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:23.552577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.583078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313d1cbc-4357-427b-a19c-3704df025fd4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.625690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.626483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.626764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.627034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.637666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.639201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.654158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e80324-652f-4789-b31b-daaa4aa7dd76 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:23.656869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:23.657927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:23.658889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:23.658889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:23.658889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:23.658889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:23.658889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 443/893] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:23.658889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.695346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.696363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.696843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.697300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.698201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:23.698776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.700385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.712365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 451/894] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:23.713312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.767746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29db423-f4d0-4d37-951b-8abcdabea951 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.800019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.800677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.800959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.801235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.801934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:23.802239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.803654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.808410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 444/895] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:23.809181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.817795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05854f-428a-480b-9d4a-ee940554cdd9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.850213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.850876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.851190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.851475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.852199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:23.852509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.853868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.869736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 452/896] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:23.869736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.918446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354796a-2b6a-4491-9ac7-27a46a3bce6b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:23.956548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:23.957494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:23.957946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:23.958222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:23.958925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:23.959268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:23.960644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:23.965024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 445/897] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:23.965788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:23.975317 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab9566-aec6-4a89-b605-1ae6bded29d1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.012994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.013748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.014156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.014538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.015577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] RBAC: Adding query filter params (interface=public, service_id=9052998a96b24e96b1df5670cff04e89, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:24.015946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.017381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.023177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 453/898] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/endpoints?service_id=9052998a96b24e96b1df5670cff04e89&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:24.029061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:24.119055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e71b18-237b-49b2-8573-e0e5dceff797 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.152502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17c228-5569-4a23-9f2c-9bee4563bf81 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.156164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b28ba-88ec-4100-86c6-fec323e72f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.156985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b28ba-88ec-4100-86c6-fec323e72f98 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.157267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b28ba-88ec-4100-86c6-fec323e72f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.157544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b28ba-88ec-4100-86c6-fec323e72f98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.165939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b28ba-88ec-4100-86c6-fec323e72f98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.167445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b28ba-88ec-4100-86c6-fec323e72f98 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-b22b28ba-88ec-4100-86c6-fec323e72f98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:24.183232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:24.186830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 446/899] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcba0-7f62-4536-8eef-a6995df61843 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.187978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcba0-7f62-4536-8eef-a6995df61843 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.193029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dcba0-7f62-4536-8eef-a6995df61843 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.193029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 447/900] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:24.193029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcba0-7f62-4536-8eef-a6995df61843 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:24.197760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d594994-cbec-4fd6-bcb4-e70de31792d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.198433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d594994-cbec-4fd6-bcb4-e70de31792d2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.198721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d594994-cbec-4fd6-bcb4-e70de31792d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.198999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d594994-cbec-4fd6-bcb4-e70de31792d2 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.199784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d594994-cbec-4fd6-bcb4-e70de31792d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.201184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d594994-cbec-4fd6-bcb4-e70de31792d2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.211382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 454/901] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:24 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:51:24.211382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded285-c1a7-4feb-9978-17c3f3345f0c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.211382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded285-c1a7-4feb-9978-17c3f3345f0c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.211382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ded285-c1a7-4feb-9978-17c3f3345f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.247541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-55ded285-c1a7-4feb-9978-17c3f3345f0c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:24.249507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-55ded285-c1a7-4feb-9978-17c3f3345f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:24.324045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dcba0-7f62-4536-8eef-a6995df61843 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.327427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 455/902] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:24.355233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded285-c1a7-4feb-9978-17c3f3345f0c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:24.369371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.370234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.370521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.371315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.372336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:24.372782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.375014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.387988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 448/903] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:24.394910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:24.478165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ded285-c1a7-4feb-9978-17c3f3345f0c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.506005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077fd6f-9952-42c3-bcf1-b3f9379de3fb None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.521580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.522405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.522688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.522994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.524052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.525893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:24.541811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:24.542849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:24.543756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:24.547562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 456/904] 10.222.0.49 () {56 vars in 1132 bytes} [Tue May 10 20:51:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:24.548210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.549116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.549621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.550100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.550293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:24.551515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] RBAC: Adding query filter params (role.id=f22690693f0b45ea8144ac9a8767b01f, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=b393a07dc5f64481938d72412e27bc02) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:24.552094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.553812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.560972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 449/905] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:24 2022] GET /identity/v3/role_assignments?user.id=b393a07dc5f64481938d72412e27bc02&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=f22690693f0b45ea8144ac9a8767b01f => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:24.661760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdca1a-d23a-46c5-9e4c-2a235b6104f1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.697771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.698454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.698741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.699023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.699786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:24.700097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.702095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.707939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 457/906] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:24.714101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:24.826940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d072a35-33ca-4696-bfb2-345138313aa9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:24.863097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:24.864179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:24.864734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:24.865193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:24.866111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:24.866617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:24.868278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:24.874466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 450/907] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:24.880483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:24.984345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a79fab-cd9f-4d5a-8675-2f058bcc3287 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:25.018563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59976d60-db15-40c4-ba7a-bd41f241ced4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:25.019563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59976d60-db15-40c4-ba7a-bd41f241ced4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:25.020036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59976d60-db15-40c4-ba7a-bd41f241ced4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:25.020496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59976d60-db15-40c4-ba7a-bd41f241ced4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:25.021494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59976d60-db15-40c4-ba7a-bd41f241ced4 None admin] RBAC: Adding query filter params (interface=public, service_id=55dcc88ae66b4391bfbfb08228390037, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:25.022006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59976d60-db15-40c4-ba7a-bd41f241ced4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:25.023592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59976d60-db15-40c4-ba7a-bd41f241ced4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:25.029308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 458/908] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:51:24 2022] GET /identity/v3/endpoints?service_id=55dcc88ae66b4391bfbfb08228390037&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:25.035660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:25.139799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e757c-e2c4-4e1c-8696-e3e561192385 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:25.176586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb5190-97df-4aa7-9a90-740eec88c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:25.177581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5190-97df-4aa7-9a90-740eec88c42a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:25.178047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5190-97df-4aa7-9a90-740eec88c42a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:25.178506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb5190-97df-4aa7-9a90-740eec88c42a None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:25.179399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb5190-97df-4aa7-9a90-740eec88c42a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:25.181051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb5190-97df-4aa7-9a90-740eec88c42a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:25.191615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 451/909] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:25 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:51:26.260707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8be04-9cb9-4737-8dcf-f77abb602e70 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.261258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8be04-9cb9-4737-8dcf-f77abb602e70 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.261258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8be04-9cb9-4737-8dcf-f77abb602e70 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.262852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 459/910] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:26.268819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b238-19d3-47f3-aef0-cb6cf3d76adb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.269246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b238-19d3-47f3-aef0-cb6cf3d76adb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.269349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80b238-19d3-47f3-aef0-cb6cf3d76adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.287608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5c80b238-19d3-47f3-aef0-cb6cf3d76adb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:26.288794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5c80b238-19d3-47f3-aef0-cb6cf3d76adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:26.364636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 452/911] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:26.386786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8be04-9cb9-4737-8dcf-f77abb602e70 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:26.493948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8be04-9cb9-4737-8dcf-f77abb602e70 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:26.529270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:26.530820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.531354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.531837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.532772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:26.534367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:26.534836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a31f-0554-4bbb-8481-1c9bead6280f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.535147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a31f-0554-4bbb-8481-1c9bead6280f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.535417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a31f-0554-4bbb-8481-1c9bead6280f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.536977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 453/912] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:26.541885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c55e-0e4e-4a6c-a977-2a977d055241 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.542172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c55e-0e4e-4a6c-a977-2a977d055241 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.542449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413c55e-0e4e-4a6c-a977-2a977d055241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.559259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5413c55e-0e4e-4a6c-a977-2a977d055241 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:26.560426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5413c55e-0e4e-4a6c-a977-2a977d055241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:26.629830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 460/913] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:26 2022] POST /identity/v3/services => generated 241 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:26.648270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 454/914] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:26.672844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:26.794878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6eea2f-7830-4ed3-bd04-8e71dcf01448 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:26.833109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e881a-efb0-445b-8225-531bf67a3205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:26.834269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e881a-efb0-445b-8225-531bf67a3205 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.834759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e881a-efb0-445b-8225-531bf67a3205 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.835273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e881a-efb0-445b-8225-531bf67a3205 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.836140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e881a-efb0-445b-8225-531bf67a3205 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:26.838089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e881a-efb0-445b-8225-531bf67a3205 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6c6e881a-efb0-445b-8225-531bf67a3205 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:26.850865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:26.851904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 10 20:51:26.852852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:26.855016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 461/915] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:26.861996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413c55e-0e4e-4a6c-a977-2a977d055241 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:26.893437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc9a1-9986-47ca-b193-24e696e090a9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.893760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc9a1-9986-47ca-b193-24e696e090a9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.893999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcc9a1-9986-47ca-b193-24e696e090a9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.896602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 462/916] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:26.900703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422efa-fa8e-446b-a8ed-16b9eb925b76 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:26.900990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422efa-fa8e-446b-a8ed-16b9eb925b76 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:26.901261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73422efa-fa8e-446b-a8ed-16b9eb925b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:26.917944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-73422efa-fa8e-446b-a8ed-16b9eb925b76 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:26.919143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-73422efa-fa8e-446b-a8ed-16b9eb925b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:26.977690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413c55e-0e4e-4a6c-a977-2a977d055241 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.003474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 463/917] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:27.019197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.019868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.020196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.020472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.021178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:27.021539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:27.022915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:27.028225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 455/918] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:27.032798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73422efa-fa8e-446b-a8ed-16b9eb925b76 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.034648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.150652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73422efa-fa8e-446b-a8ed-16b9eb925b76 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.152582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5e55a-7530-4ba9-b381-b56bbbc9b705 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.188190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.188439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.188859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.189139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.189412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.190123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:27.190409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.190514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:27.190977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.191472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.191820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:27.201785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 456/919] 10.222.0.49 () {56 vars in 1114 bytes} [Tue May 10 20:51:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:27.202885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.210050 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:27.220343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:27.221336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:27.222208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:27.225164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 464/920] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 20:51:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:27.234586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.375373 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b6151e-cbbb-4a76-a994-e3252e92e716 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.444639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca480db-9f38-4ab9-a9fc-1be3c9d7953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.453994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca480db-9f38-4ab9-a9fc-1be3c9d7953b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.459533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca480db-9f38-4ab9-a9fc-1be3c9d7953b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.460052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca480db-9f38-4ab9-a9fc-1be3c9d7953b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.461041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca480db-9f38-4ab9-a9fc-1be3c9d7953b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:27.466558 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca480db-9f38-4ab9-a9fc-1be3c9d7953b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:27.491173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739863-06fd-4c18-936d-908f5813e80e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.525800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129786b-30f0-4ee4-a0f2-795f3f6be831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.539267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129786b-30f0-4ee4-a0f2-795f3f6be831 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.539267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129786b-30f0-4ee4-a0f2-795f3f6be831 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.539267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129786b-30f0-4ee4-a0f2-795f3f6be831 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.539267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129786b-30f0-4ee4-a0f2-795f3f6be831 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:27.539267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129786b-30f0-4ee4-a0f2-795f3f6be831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:27.539267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129786b-30f0-4ee4-a0f2-795f3f6be831 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:27.539706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 465/921] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 20:51:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:27.539706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8bee-e2f5-4a62-9498-1c1165151c22 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.540030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8bee-e2f5-4a62-9498-1c1165151c22 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.540166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d8bee-e2f5-4a62-9498-1c1165151c22 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.546092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 466/922] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:27.546092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8bee-e2f5-4a62-9498-1c1165151c22 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.564561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 457/923] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:27.568708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bdb68-78d8-4064-86ac-fbec6347c863 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.569000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bdb68-78d8-4064-86ac-fbec6347c863 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.569268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10bdb68-78d8-4064-86ac-fbec6347c863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.590552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b10bdb68-78d8-4064-86ac-fbec6347c863 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:27.592478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b10bdb68-78d8-4064-86ac-fbec6347c863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:27.695236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 458/924] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:27.713531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bdb68-78d8-4064-86ac-fbec6347c863 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.750147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d8bee-e2f5-4a62-9498-1c1165151c22 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.797697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.798503 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.798794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.799088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.809735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:27.812724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:27.831706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:27.832721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:27.833628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:27.833628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:27.833628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:27.833628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:27.833628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 467/925] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:27.838554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.844699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10bdb68-78d8-4064-86ac-fbec6347c863 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.883542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.884378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.884661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.884932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.885587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:27.887019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:27.899624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:27.900592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:27.901453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 459/926] 10.222.0.49 () {56 vars in 1132 bytes} [Tue May 10 20:51:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:27.909344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:27.947056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d05aaa-3ad9-495d-9400-6068ffdf005b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:27.982509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:27.983628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:27.984100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:27.984525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:27.985407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:27.985959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:27.987529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.000973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 468/927] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:28.006020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:28.035383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a162f8-2bb2-42fe-b943-be408241b6f9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.070978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.072080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.072542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.073011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.073923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:28.074457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.076072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.082452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 460/928] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:28.090179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:28.117084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a30eeb-8326-4425-b74f-947ea2782620 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.161521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.162344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.162625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.162905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.173140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.174895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.188899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3e624-214d-4e4f-bfd2-7ef42f6cd6f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:28.194544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:28.195549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:28.196526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:28.197120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 469/929] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:51:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:28.202794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:28.231442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.232705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.233498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.234259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.235371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:28.236211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.238271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.245074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 461/930] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:28.250278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:28.319010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354effd0-5163-4fed-b24a-f5c120eb3966 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.353496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431527-0298-491b-a85a-f002801e5447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.354141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431527-0298-491b-a85a-f002801e5447 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.354424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431527-0298-491b-a85a-f002801e5447 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.354698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98431527-0298-491b-a85a-f002801e5447 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.355596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98431527-0298-491b-a85a-f002801e5447 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:28.355906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98431527-0298-491b-a85a-f002801e5447 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.357333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98431527-0298-491b-a85a-f002801e5447 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.360710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4171edd-c747-48ac-a53f-4d8739bae18d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.375757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 470/931] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 20:51:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:28.382331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431527-0298-491b-a85a-f002801e5447 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:28.406137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d39f2-1698-4068-a169-b76966861403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.406824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d39f2-1698-4068-a169-b76966861403 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.407056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d39f2-1698-4068-a169-b76966861403 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.407359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d39f2-1698-4068-a169-b76966861403 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.408409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d39f2-1698-4068-a169-b76966861403 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.409950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d39f2-1698-4068-a169-b76966861403 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.485387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98431527-0298-491b-a85a-f002801e5447 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.504110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 462/932] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:28 2022] POST /identity/v3/endpoints => generated 347 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:28.539007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.540731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.541226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.541775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.554531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.556464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:28.576274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:28.578130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:28.579098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:28.579098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:28.579098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:28.579098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:28.581690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 471/933] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:28.587858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d39f2-1698-4068-a169-b76966861403 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:28.710169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d39f2-1698-4068-a169-b76966861403 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.745439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.746038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.746327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.746608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.747364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:28.747672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.749769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.762483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 463/934] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:28.768314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:28.877833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cebf5b-aa11-4cba-bc02-0e1dc2968339 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:28.912166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580a86b-77ba-4b3d-8cf9-4562415129b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:28.912988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580a86b-77ba-4b3d-8cf9-4562415129b6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:28.913274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580a86b-77ba-4b3d-8cf9-4562415129b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:28.913551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580a86b-77ba-4b3d-8cf9-4562415129b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:28.920698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580a86b-77ba-4b3d-8cf9-4562415129b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:28.922413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580a86b-77ba-4b3d-8cf9-4562415129b6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f580a86b-77ba-4b3d-8cf9-4562415129b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:28.936935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:28.937875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:28.938792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 472/935] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:28.944258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:29.004765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05376b2f-1c2f-4a39-b2f2-c8e08e37f9aa None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.004977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05376b2f-1c2f-4a39-b2f2-c8e08e37f9aa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.005263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05376b2f-1c2f-4a39-b2f2-c8e08e37f9aa None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.006621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 473/936] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:29.011737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018142e-01b5-4ab5-9fb5-1013a331df31 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.012023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018142e-01b5-4ab5-9fb5-1013a331df31 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.012299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018142e-01b5-4ab5-9fb5-1013a331df31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.032005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3018142e-01b5-4ab5-9fb5-1013a331df31 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:29.033744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3018142e-01b5-4ab5-9fb5-1013a331df31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:29.053902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18645b63-2cf3-4311-9fce-c0edb770f500 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:29.094029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:29.094996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.095514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.095972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.096981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:29.097515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:29.099190 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:29.112234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 464/937] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:29.118236 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 474/938] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:29.118386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:29.139612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018142e-01b5-4ab5-9fb5-1013a331df31 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:29.224531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5326ec-c778-4dc9-9a4b-26a5fdbb62ef None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:29.257652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018142e-01b5-4ab5-9fb5-1013a331df31 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:29.267679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:29.268834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.269303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.270128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/b393a07dc5f64481938d72412e27bc02/roles/f22690693f0b45ea8144ac9a8767b01f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.273283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=b393a07dc5f64481938d72412e27bc02, role_id=f22690693f0b45ea8144ac9a8767b01f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:29.275762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:29.294545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:29.296197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.296686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.296869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.297519 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:29.298890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:29.310909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:29.312177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:29.318310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 475/939] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:29.319165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:29.383462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 465/940] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:51:29 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/b393a07dc5f64481938d72412e27bc02/roles/f22690693f0b45ea8144ac9a8767b01f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:51:29.431786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f5d19-c1eb-4e4d-aef6-c51409a247d8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:29.472456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:29.473536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.474025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.474512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.475491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:29.476341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:29.478987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:29.485922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 476/941] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:29.492038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:29.608725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4b482-e612-4b57-aa06-f9202416c2f5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:29.647340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:29.647996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.648278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.648552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.649259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:29.649568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:29.650948 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:29.656674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 466/942] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:29.662456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:29.768543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b8d1-bb07-47c2-902f-7b135dc8a366 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:29.809145 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b589e-20ba-4512-9378-fa1eb3990542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:29.809808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b589e-20ba-4512-9378-fa1eb3990542 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.810091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b589e-20ba-4512-9378-fa1eb3990542 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.810369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b589e-20ba-4512-9378-fa1eb3990542 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.811654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b589e-20ba-4512-9378-fa1eb3990542 None admin] RBAC: Adding query filter params (interface=public, service_id=d17c6f97a47b4096911158e81141ed7d, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:29.811970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b589e-20ba-4512-9378-fa1eb3990542 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:29.813347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b589e-20ba-4512-9378-fa1eb3990542 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:29.818932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 477/943] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:51:29 2022] GET /identity/v3/endpoints?service_id=d17c6f97a47b4096911158e81141ed7d&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:29.824221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:29.931134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca50240-d822-4397-98e3-8e2a6a91ed5a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:29.959469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbb11-5a49-40e7-8ca2-69b77fdcd57e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.959790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbb11-5a49-40e7-8ca2-69b77fdcd57e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.960033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecefbb11-5a49-40e7-8ca2-69b77fdcd57e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.963229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 478/944] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:29.966552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:29.966714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb133-8796-4c09-81a2-d6f430381e86 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.966986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb133-8796-4c09-81a2-d6f430381e86 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.967475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7bb133-8796-4c09-81a2-d6f430381e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.967843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:29.968137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:29.968419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:29.969301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:29.970911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:29.979088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 467/945] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:29 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:51:29.987351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bc7bb133-8796-4c09-81a2-d6f430381e86 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:29.988603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bc7bb133-8796-4c09-81a2-d6f430381e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:30.071290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 479/946] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:30.089015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:30.204309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4333e-76df-4e5d-8387-566d9699d2c0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:30.239550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:30.240304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:30.240588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:30.240865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:30.241640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:30.243092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:30.244497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING keystone.server.flask.common [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 20:51:30.301302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.sql.core [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 20:51:30.301302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 20:51:30.301302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [parameters: {'id': 'd3e2a17b7e264fc78fe7dc301e680d5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 20:51:30.301302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80290) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3e2a17b7e264fc78fe7dc301e680d5d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3e2a17b7e264fc78fe7dc301e680d5d. May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:51:30.309736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 10 20:51:30.324206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return project_ref.to_dict() May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application yield resource May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application next(self.gen) May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.rollback() May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.force_reraise() May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise self.value May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application session.commit() May 10 20:51:30.325200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._prepare_impl() May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.session.flush() May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._flush(objects) May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application compat.raise_( May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application flush_context.execute() May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 20:51:30.326138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rec.execute(self) May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application c = connection._execute_20( May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 20:51:30.327100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application conn.query(q) May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application result.read() May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:51:30.328061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [parameters: {'id': 'd3e2a17b7e264fc78fe7dc301e680d5d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:30.328949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:30.329735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.Conflict( May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d3e2a17b7e264fc78fe7dc301e680d5d. May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:30.330679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 468/947] 10.222.0.49 () {60 vars in 1140 bytes} [Tue May 10 20:51:30 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:30.332808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb133-8796-4c09-81a2-d6f430381e86 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:30.428462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7bb133-8796-4c09-81a2-d6f430381e86 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:30.462278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d988909-36b9-4f41-ae13-989feb641f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:30.463428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988909-36b9-4f41-ae13-989feb641f02 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:30.463927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988909-36b9-4f41-ae13-989feb641f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:30.464425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d988909-36b9-4f41-ae13-989feb641f02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:30.472407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d988909-36b9-4f41-ae13-989feb641f02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:30.474147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d988909-36b9-4f41-ae13-989feb641f02 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-7d988909-36b9-4f41-ae13-989feb641f02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:30.488005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:30.488940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:30.489857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:30.495738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 480/948] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:30.500456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:30.621430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b55917-7b0d-4450-ae8a-7bcf6ca31a87 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:30.658058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e95506-8dfe-4666-ae65-f2cf49e49abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:30.658730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95506-8dfe-4666-ae65-f2cf49e49abb None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:30.659016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95506-8dfe-4666-ae65-f2cf49e49abb None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:30.659314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e95506-8dfe-4666-ae65-f2cf49e49abb None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:30.660083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e95506-8dfe-4666-ae65-f2cf49e49abb None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:30.660391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e95506-8dfe-4666-ae65-f2cf49e49abb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:30.662070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e95506-8dfe-4666-ae65-f2cf49e49abb None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:30.690916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 469/949] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:30.876059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27648-9014-4e61-a863-4cce77d6dce9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:30.876569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27648-9014-4e61-a863-4cce77d6dce9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:30.876648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27648-9014-4e61-a863-4cce77d6dce9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:30.878175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 481/950] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:30.883484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366448-da2a-420c-813c-493b40fbbef9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:30.883778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366448-da2a-420c-813c-493b40fbbef9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:30.884057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58366448-da2a-420c-813c-493b40fbbef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:30.901944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-58366448-da2a-420c-813c-493b40fbbef9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:30.903857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58366448-da2a-420c-813c-493b40fbbef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:30.975155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 470/951] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:30.996904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a27648-9014-4e61-a863-4cce77d6dce9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:31.100667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a27648-9014-4e61-a863-4cce77d6dce9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:31.140606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:31.141382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:31.141669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:31.141942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:31.142608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:31.144012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:31.157386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:31.158399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:31.159447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 482/952] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:31.164579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58366448-da2a-420c-813c-493b40fbbef9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:31.271644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58366448-da2a-420c-813c-493b40fbbef9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:31.310216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fec555-5e23-46cc-9c25-d09a5d308f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:31.311610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec555-5e23-46cc-9c25-d09a5d308f3b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:31.312199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec555-5e23-46cc-9c25-d09a5d308f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:31.312672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec555-5e23-46cc-9c25-d09a5d308f3b None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:31.313607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fec555-5e23-46cc-9c25-d09a5d308f3b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:31.314110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fec555-5e23-46cc-9c25-d09a5d308f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:31.315711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fec555-5e23-46cc-9c25-d09a5d308f3b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:31.321332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 471/953] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:31.330643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:31.432552 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c1bcd-a460-4fe4-a180-1e596304baaf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:31.465931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574deee-87b1-4d20-b865-d0b5fa27cd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:31.466594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574deee-87b1-4d20-b865-d0b5fa27cd6c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:31.466994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574deee-87b1-4d20-b865-d0b5fa27cd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:31.467233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574deee-87b1-4d20-b865-d0b5fa27cd6c None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:31.467953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574deee-87b1-4d20-b865-d0b5fa27cd6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:31.468255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574deee-87b1-4d20-b865-d0b5fa27cd6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:31.469623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574deee-87b1-4d20-b865-d0b5fa27cd6c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:31.474853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 483/954] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:31.764514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff60df-ba02-45c2-a885-672c7c5576cf None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:31.765031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff60df-ba02-45c2-a885-672c7c5576cf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:31.765031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff60df-ba02-45c2-a885-672c7c5576cf None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:31.766667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 472/955] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:31.772499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a86c-a29b-4b27-b9c6-2622342dd7f1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:31.772791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a86c-a29b-4b27-b9c6-2622342dd7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:31.773068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a86c-a29b-4b27-b9c6-2622342dd7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:31.791433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6716a86c-a29b-4b27-b9c6-2622342dd7f1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:31.792617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6716a86c-a29b-4b27-b9c6-2622342dd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:31.863241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 484/956] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:31.882594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff60df-ba02-45c2-a885-672c7c5576cf None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:31.990383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff60df-ba02-45c2-a885-672c7c5576cf None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.027511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.028293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.028573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.028844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.039943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:32.049099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:32.050036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:32.050899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 473/957] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 20:51:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:32.056413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a86c-a29b-4b27-b9c6-2622342dd7f1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.159737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a86c-a29b-4b27-b9c6-2622342dd7f1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.198347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1eab72-8ed6-4e42-b173-52cbb087d2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.199387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eab72-8ed6-4e42-b173-52cbb087d2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.199665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eab72-8ed6-4e42-b173-52cbb087d2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.200002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1eab72-8ed6-4e42-b173-52cbb087d2d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.200783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eab72-8ed6-4e42-b173-52cbb087d2d9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:32.201196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eab72-8ed6-4e42-b173-52cbb087d2d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:32.203446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1eab72-8ed6-4e42-b173-52cbb087d2d9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:32.213088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 485/958] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:32.219212 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.319065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51603efc-ff8b-4ff3-ace7-39aacf525446 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.357337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.358831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.359110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.359408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.370456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:32.371937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:32.378193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9142c2-36b4-4f05-b457-cee9712d1f4a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.378486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9142c2-36b4-4f05-b457-cee9712d1f4a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.378765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9142c2-36b4-4f05-b457-cee9712d1f4a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.380419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 486/959] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:32.385253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4f2f-b701-47c6-8a80-6f0ed68f0b8f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.385550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4f2f-b701-47c6-8a80-6f0ed68f0b8f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.385833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f4f2f-b701-47c6-8a80-6f0ed68f0b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:32.390723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:32.392823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:32.394897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:32.394897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:32.394897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:32.394897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:32.394897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 474/960] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:32.397638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.407993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2a8f4f2f-b701-47c6-8a80-6f0ed68f0b8f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:32.409456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2a8f4f2f-b701-47c6-8a80-6f0ed68f0b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:32.476559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 487/961] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:32.499536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4f2f-b701-47c6-8a80-6f0ed68f0b8f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.521145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3dd58-a238-4530-b7dc-0b2ba1b968a0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.555867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.556629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.556981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.557328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.558132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:32.558615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:32.560049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:32.573072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 475/962] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:32.580597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.616774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f4f2f-b701-47c6-8a80-6f0ed68f0b8f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.656476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.657166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.657453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.657730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.658572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:32.660000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:32.672451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:32.673472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:32.674352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:32.678988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 488/963] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:32.679933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.714519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23b08b-2387-4a56-ab95-157eb224203c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.750781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.751696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.751992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.752236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.760093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:32.761589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:32.777955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:32.780183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 10 20:51:32.781528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:32.783485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 476/964] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:32.785292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.799954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9587e-efbb-4cd9-9141-b5945ef256e1 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.834309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.835349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.835834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.836307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.837245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:32.837751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:32.839361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:32.845002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 489/965] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:32.850398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:32.902710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844701cb-aebb-4efd-ae7a-bd413f736c39 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.944369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:32.945831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:32.946435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:32.946909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:32.948475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:32.949259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:32.951190 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:32.973672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337411fb-862b-4d46-b202-5a88b5341302 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:32.974019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 477/966] 10.222.0.49 () {56 vars in 1149 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:32.980261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.013468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.015251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.015757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.016230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.017150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:33.017654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.019259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.024975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 490/967] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:33.031427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.089760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5de0f-01a8-4a3b-9627-6bca166f4783 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:33.124995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.125691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.125932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.126268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.132733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a423eb-3284-4b05-ab3f-e5e3537e00fb None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:33.167504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f2d45-133f-481a-a1ff-9b5e4e147f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.168540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2d45-133f-481a-a1ff-9b5e4e147f4c None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.169035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2d45-133f-481a-a1ff-9b5e4e147f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.169524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f2d45-133f-481a-a1ff-9b5e4e147f4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.170613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2d45-133f-481a-a1ff-9b5e4e147f4c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.172512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f2d45-133f-481a-a1ff-9b5e4e147f4c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.196769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.200453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.287937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 491/968] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:33.289331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a04e-c56c-495d-8037-17503ba89359 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.289628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a04e-c56c-495d-8037-17503ba89359 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.289906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a04e-c56c-495d-8037-17503ba89359 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.295471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 492/969] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:33.297448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1b5f2-53b5-448b-9769-5eba7f9f5328 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.297727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1b5f2-53b5-448b-9769-5eba7f9f5328 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.298006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1b5f2-53b5-448b-9769-5eba7f9f5328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.314916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 478/970] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:32 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:33.321301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.329044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4ae1b5f2-53b5-448b-9769-5eba7f9f5328 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:33.330278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4ae1b5f2-53b5-448b-9769-5eba7f9f5328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:33.431241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 493/971] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:33.454791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1b5f2-53b5-448b-9769-5eba7f9f5328 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.456710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02125d22-8e5b-4bce-bf81-95a0a049b4e5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:33.493277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.493700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.493981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.494230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.504913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.506391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:33.528627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:33.530228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:33.531308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:33.531308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:33.531308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:33.531308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:33.531308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 479/972] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:33.536561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.578437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1b5f2-53b5-448b-9769-5eba7f9f5328 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:33.626548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.627727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.628247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.628739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.629652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.631328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.632868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING keystone.server.flask.common [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 10 20:51:33.659374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a85e95-c19e-4f90-8820-42dcc4100892 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:33.673542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.sql.core [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 20:51:33.673542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 20:51:33.673542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [parameters: {'user_id': '395d58067eb1493394b5c16e64eea532', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 20:51:33.673542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80291) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application conn.query(q) May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application result.read() May 10 20:51:33.695347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:51:33.696390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application next(self.gen) May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application yield resource May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application next(self.gen) May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.session.rollback() May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.force_reraise() May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise self.value May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application session.commit() May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 10 20:51:33.697409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._prepare_impl() May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.session.flush() May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._flush(objects) May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application compat.raise_( May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application flush_context.execute() May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rec.execute(self) May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 10 20:51:33.698354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application _emit_insert_statements( May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application result = connection._execute_20( May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ret = self._execute_context( May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 10 20:51:33.699363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.dialect.do_execute( May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application result = self._query(query) May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application conn.query(q) May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application result.read() May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 10 20:51:33.700258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application packet.raise_for_error() May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [parameters: {'user_id': '395d58067eb1493394b5c16e64eea532', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:33.704022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 10 20:51:33.706019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 10 20:51:33.710980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 10 20:51:33.710980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 10 20:51:33.710980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 10 20:51:33.710980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 10 20:51:33.710980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 10 20:51:33.710980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:33.711736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.711736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.711736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.711736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.712244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:33.712244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.712244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.712906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 494/973] 10.222.0.49 () {60 vars in 1131 bytes} [Tue May 10 20:51:33 2022] POST /identity/v3/users => generated 160 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:33.716736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.718579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 480/974] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:33.724195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.837337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e5f59-300e-4a9e-9dd8-0b2cf1a3c5fc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:33.840257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed73981-6a1b-443c-a142-0700c5a84707 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:33.871920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f0eac-231b-4274-b515-fa015e17716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.872818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0eac-231b-4274-b515-fa015e17716e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.873134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0eac-231b-4274-b515-fa015e17716e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.873929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f0eac-231b-4274-b515-fa015e17716e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.874918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:33.875833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.876153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.876702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.880728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0eac-231b-4274-b515-fa015e17716e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.882183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f0eac-231b-4274-b515-fa015e17716e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.884155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:33.885769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9f6f0eac-231b-4274-b515-fa015e17716e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:33.898015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:33.898904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:33.908202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 481/975] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:33.908974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:33.909979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 10 20:51:33.911153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:33.911836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4f84-c5c4-4646-9e6c-4a5ba02cf88a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.911921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 495/976] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:33.912011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4f84-c5c4-4646-9e6c-4a5ba02cf88a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.912011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a4f84-c5c4-4646-9e6c-4a5ba02cf88a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.912011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 482/977] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:33.912235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:33.912318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef24d-14d2-4990-8799-f763accc8af8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:33.912318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef24d-14d2-4990-8799-f763accc8af8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:33.912318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ef24d-14d2-4990-8799-f763accc8af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:33.929949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f02ef24d-14d2-4990-8799-f763accc8af8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:33.931150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f02ef24d-14d2-4990-8799-f763accc8af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:33.996101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 483/978] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:33.997056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ef24d-14d2-4990-8799-f763accc8af8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:34.012941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f4979f-a981-4c8d-b3fb-b46759878977 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:34.048455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:34.049128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:34.049407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:34.049679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:34.050500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:34.050802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:34.052252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:34.099154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 496/979] 10.222.0.49 () {56 vars in 1101 bytes} [Tue May 10 20:51:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:34.099154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:34.126316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ef24d-14d2-4990-8799-f763accc8af8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:34.171685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:34.173313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:34.173598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:34.173877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:34.174738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:34.175052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:34.176547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:34.192967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 484/980] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:34.198262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:34.208684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff27d2-264e-4dfa-8982-0c8cd14eecba None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:34.260672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604f6d4-ec2e-42a2-bd2f-599df0cac2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:34.261945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604f6d4-ec2e-42a2-bd2f-599df0cac2ac None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:34.262406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604f6d4-ec2e-42a2-bd2f-599df0cac2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:34.262863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604f6d4-ec2e-42a2-bd2f-599df0cac2ac None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:34.264405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604f6d4-ec2e-42a2-bd2f-599df0cac2ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:34.266567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604f6d4-ec2e-42a2-bd2f-599df0cac2ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:34.318151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec60787-fc2b-405a-a75d-6fb521c5aa4d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:34.355443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a002362b-6b5c-4ddf-b423-a4e2f230732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:34.356402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002362b-6b5c-4ddf-b423-a4e2f230732d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:34.356690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002362b-6b5c-4ddf-b423-a4e2f230732d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:34.356978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a002362b-6b5c-4ddf-b423-a4e2f230732d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:34.358344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002362b-6b5c-4ddf-b423-a4e2f230732d None admin] RBAC: Adding query filter params (role.id=f22690693f0b45ea8144ac9a8767b01f, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=b393a07dc5f64481938d72412e27bc02) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:34.358742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002362b-6b5c-4ddf-b423-a4e2f230732d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:34.360288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a002362b-6b5c-4ddf-b423-a4e2f230732d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:34.366699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 485/981] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:34 2022] GET /identity/v3/role_assignments?user.id=b393a07dc5f64481938d72412e27bc02&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=f22690693f0b45ea8144ac9a8767b01f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:34.380204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 497/982] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:34 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:35.596679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b042-e051-4b3e-aa99-18683a977dfa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:35.597233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b042-e051-4b3e-aa99-18683a977dfa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:35.597233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300b042-e051-4b3e-aa99-18683a977dfa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:35.599077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 486/983] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:35.604304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec60c0-a5d9-4245-827e-7f8eaf12a09e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:35.604718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec60c0-a5d9-4245-827e-7f8eaf12a09e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:35.604816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec60c0-a5d9-4245-827e-7f8eaf12a09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:35.621936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-91ec60c0-a5d9-4245-827e-7f8eaf12a09e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:35.624008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-91ec60c0-a5d9-4245-827e-7f8eaf12a09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:35.703149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 498/984] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:35.721903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b042-e051-4b3e-aa99-18683a977dfa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:35.822625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300b042-e051-4b3e-aa99-18683a977dfa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:35.854919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:35.855681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:35.855964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:35.856239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:35.856893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:35.858785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:35.870406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:35.871709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:35.872608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:35.875263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 487/985] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:35.880512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec60c0-a5d9-4245-827e-7f8eaf12a09e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:35.972460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec60c0-a5d9-4245-827e-7f8eaf12a09e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:36.004929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:36.005944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.006423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.006900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.007913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:36.008418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:36.009983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:36.016017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 499/986] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:36.021708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:36.120261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a35ed-ad68-4a05-8759-24dfe89321b6 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:36.153969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:36.155550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.155550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.155834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.156553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:36.156862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:36.158296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:36.163313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 488/987] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:36.169085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:36.265854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba168a0-9052-40ea-9578-03baea972d01 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:36.298919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d10e4-53c5-441c-8868-de30bd6b6ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:36.299614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d10e4-53c5-441c-8868-de30bd6b6ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.299898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d10e4-53c5-441c-8868-de30bd6b6ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.300175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d10e4-53c5-441c-8868-de30bd6b6ca0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.300987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d10e4-53c5-441c-8868-de30bd6b6ca0 None admin] RBAC: Adding query filter params (interface=admin, service_id=d17c6f97a47b4096911158e81141ed7d, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:36.301311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d10e4-53c5-441c-8868-de30bd6b6ca0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:36.302670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d10e4-53c5-441c-8868-de30bd6b6ca0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:36.312871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 500/988] 10.222.0.49 () {56 vars in 1249 bytes} [Tue May 10 20:51:36 2022] GET /identity/v3/endpoints?service_id=d17c6f97a47b4096911158e81141ed7d&interface=admin®ion_id=RegionOne => generated 193 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:36.314110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:36.452173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba2774-3b7b-418e-801f-adfebfcf7578 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:36.511081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735016d-800d-4553-a8d0-22e435475254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:36.512229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735016d-800d-4553-a8d0-22e435475254 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.512722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735016d-800d-4553-a8d0-22e435475254 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.513198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735016d-800d-4553-a8d0-22e435475254 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.515252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735016d-800d-4553-a8d0-22e435475254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:36.517811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735016d-800d-4553-a8d0-22e435475254 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:36.529653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 489/989] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:36 2022] GET /identity/v3/services => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:51:36.669358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16cc3-acf2-4c4e-995f-d22d30733550 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.669886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16cc3-acf2-4c4e-995f-d22d30733550 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.670483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec16cc3-acf2-4c4e-995f-d22d30733550 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.672404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 501/990] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:36.677811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b31fa-7b88-48c7-af4a-a935d4a455dd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.678272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b31fa-7b88-48c7-af4a-a935d4a455dd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.678350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b31fa-7b88-48c7-af4a-a935d4a455dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.696031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-040b31fa-7b88-48c7-af4a-a935d4a455dd None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:36.697244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-040b31fa-7b88-48c7-af4a-a935d4a455dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:36.765791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 490/991] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:36.787538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec16cc3-acf2-4c4e-995f-d22d30733550 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:36.836870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab503c-0c7b-4b52-bdf5-52984c1a571a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.837159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab503c-0c7b-4b52-bdf5-52984c1a571a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.837438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab503c-0c7b-4b52-bdf5-52984c1a571a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.838920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 491/992] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:36.844429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb3d58-3793-49af-a3a7-bb80be9186fa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.844711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb3d58-3793-49af-a3a7-bb80be9186fa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.844979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb3d58-3793-49af-a3a7-bb80be9186fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.862143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8beb3d58-3793-49af-a3a7-bb80be9186fa None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:36.863361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8beb3d58-3793-49af-a3a7-bb80be9186fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:36.894551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec16cc3-acf2-4c4e-995f-d22d30733550 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:36.930321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:36.931201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:36.935259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:36.935387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 492/993] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:36.935471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] PATH_INFO: `/v3/services/image` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:36.935471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:36.935471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:36.947627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:36.948722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:36.954753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 502/994] 10.222.0.49 () {56 vars in 1105 bytes} [Tue May 10 20:51:36 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:36.955591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb3d58-3793-49af-a3a7-bb80be9186fa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:36.956074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:37.055825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cd6ca-9ce0-4877-b5ec-8f163b8ffe71 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:37.056153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb3d58-3793-49af-a3a7-bb80be9186fa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:37.088218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:37.088658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:37.089010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:37.089288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:37.089387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:37.089556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:37.089670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:37.089861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:37.090208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:37.090568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] RBAC: Adding query filter params (name=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:37.090877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:37.091595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:37.092880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:37.102352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 493/995] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:37.103159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:37.103979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:37.104966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:37.111169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 503/996] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:37.113410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:37.203611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79fdd-1f54-4882-aad0-96a95f326f78 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:37.214962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc380776-2cf6-44b9-b6b5-2fdc4ad42b2b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:37.241606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:37.242412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:37.242698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:37.242975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:37.243719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] RBAC: Adding query filter params (type=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:37.244025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:37.245408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:37.250158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 494/997] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:37 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:37.251698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:37.252366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:37.252647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:37.252919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:37.253638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] RBAC: Adding query filter params (name=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:37.253942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:37.255360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:37.261139 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 504/998] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:37.267792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:37.374862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e01e0-1889-4ed9-b17b-03d2f06bff7d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:37.410520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:37.411220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:37.411500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:37.411773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:37.412491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:37.412796 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:37.414193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:37.425200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 495/999] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:37.426744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:37.523260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e833616-5f43-4cc2-8032-7942152514ac None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:37.555329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e0d09-ca51-4ed0-b352-a2cf92ff9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:37.555983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d09-ca51-4ed0-b352-a2cf92ff9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:37.556264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d09-ca51-4ed0-b352-a2cf92ff9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:37.556538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e0d09-ca51-4ed0-b352-a2cf92ff9ad3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:37.557321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d09-ca51-4ed0-b352-a2cf92ff9ad3 None admin] RBAC: Adding query filter params (interface=public, service_id=9a3eb394741e483c80048f2ff86d162f, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:37.557630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d09-ca51-4ed0-b352-a2cf92ff9ad3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:37.559008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e0d09-ca51-4ed0-b352-a2cf92ff9ad3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:37.568633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 505/1000] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:51:37 2022] GET /identity/v3/endpoints?service_id=9a3eb394741e483c80048f2ff86d162f&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:37.569824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:37.677916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1153cca-1d0d-4f9a-9cf3-4cb35c3c093e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:37.711392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65f4ab-1f8b-4919-b1a0-b17764f184cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:37.712051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f4ab-1f8b-4919-b1a0-b17764f184cc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:37.712378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f4ab-1f8b-4919-b1a0-b17764f184cc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:37.712654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65f4ab-1f8b-4919-b1a0-b17764f184cc None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:37.713332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65f4ab-1f8b-4919-b1a0-b17764f184cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:37.714760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65f4ab-1f8b-4919-b1a0-b17764f184cc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:37.722838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 496/1001] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:37 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 20:51:38.875935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725c98-2e72-4c82-98d0-6fa6c57e5799 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:38.876434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725c98-2e72-4c82-98d0-6fa6c57e5799 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:38.876434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad725c98-2e72-4c82-98d0-6fa6c57e5799 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:38.877804 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 506/1002] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:38.883008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf05aa-c433-4858-b527-6f0994486f5d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:38.883458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf05aa-c433-4858-b527-6f0994486f5d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:38.883641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf05aa-c433-4858-b527-6f0994486f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:38.900798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cbdf05aa-c433-4858-b527-6f0994486f5d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:38.901983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cbdf05aa-c433-4858-b527-6f0994486f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:38.970218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 497/1003] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:38.992296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725c98-2e72-4c82-98d0-6fa6c57e5799 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:39.092221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad725c98-2e72-4c82-98d0-6fa6c57e5799 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:39.124914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:39.125720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.126055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.126284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.126941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:39.128334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:39.140216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:39.141238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 10 20:51:39.142091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:39.149500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 507/1004] 10.222.0.49 () {56 vars in 1126 bytes} [Tue May 10 20:51:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:39.149628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf05aa-c433-4858-b527-6f0994486f5d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:39.245687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf05aa-c433-4858-b527-6f0994486f5d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:39.278534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:39.279769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.280070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.280349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.281060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:39.281372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:39.282758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:39.292800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 498/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:39.293830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:39.394164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcef54-56e3-4f21-881d-18e8b42e808c None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:39.426610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2165b-119c-4598-a5b2-c52d6726bf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:39.427307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2165b-119c-4598-a5b2-c52d6726bf6b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.427595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2165b-119c-4598-a5b2-c52d6726bf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.427875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2165b-119c-4598-a5b2-c52d6726bf6b None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.428589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2165b-119c-4598-a5b2-c52d6726bf6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:39.428897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2165b-119c-4598-a5b2-c52d6726bf6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:39.430272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2165b-119c-4598-a5b2-c52d6726bf6b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:39.440224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 508/1006] 10.222.0.49 () {56 vars in 1122 bytes} [Tue May 10 20:51:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:39.441215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:39.484802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300182b-6d99-4b0d-9455-6cd757a4d6fb None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.485139 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300182b-6d99-4b0d-9455-6cd757a4d6fb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.485354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300182b-6d99-4b0d-9455-6cd757a4d6fb None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.486713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 509/1007] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:39.491609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1e72-039d-41b5-bc0a-15355afba556 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.491896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1e72-039d-41b5-bc0a-15355afba556 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.492174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1e72-039d-41b5-bc0a-15355afba556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.509119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c61a1e72-039d-41b5-bc0a-15355afba556 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:39.510301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c61a1e72-039d-41b5-bc0a-15355afba556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:39.542869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff4049-f3c3-4078-ad1f-44635fd43f86 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:39.577851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 510/1008] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:39.578058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38456144-1c0f-4270-baf5-5647725a7005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:39.579862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456144-1c0f-4270-baf5-5647725a7005 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.580149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456144-1c0f-4270-baf5-5647725a7005 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.580425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38456144-1c0f-4270-baf5-5647725a7005 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.581177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38456144-1c0f-4270-baf5-5647725a7005 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:39.582548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38456144-1c0f-4270-baf5-5647725a7005 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:39.601817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1e72-039d-41b5-bc0a-15355afba556 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:39.661510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 499/1009] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:51:39.710415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1e72-039d-41b5-bc0a-15355afba556 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:39.754386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53766ff2-c92f-4c41-93d9-f49a787fa913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:39.755134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766ff2-c92f-4c41-93d9-f49a787fa913 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.755431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766ff2-c92f-4c41-93d9-f49a787fa913 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.755705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766ff2-c92f-4c41-93d9-f49a787fa913 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.756494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53766ff2-c92f-4c41-93d9-f49a787fa913 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:39.757823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53766ff2-c92f-4c41-93d9-f49a787fa913 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:39.822008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 511/1010] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:39 2022] POST /identity/v3/services => generated 242 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:39.985550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551cd34-609c-4440-bb94-8c8a4fd95c29 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.986053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551cd34-609c-4440-bb94-8c8a4fd95c29 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.986053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551cd34-609c-4440-bb94-8c8a4fd95c29 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:39.987587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 500/1011] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:39.993216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabecae-2dab-4935-a65e-a5efa94ef9bc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:39.993712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabecae-2dab-4935-a65e-a5efa94ef9bc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:39.993790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eabecae-2dab-4935-a65e-a5efa94ef9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:40.012370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1eabecae-2dab-4935-a65e-a5efa94ef9bc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:40.013557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1eabecae-2dab-4935-a65e-a5efa94ef9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:40.085594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 512/1012] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:39 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:40.108966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551cd34-609c-4440-bb94-8c8a4fd95c29 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:40.213725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551cd34-609c-4440-bb94-8c8a4fd95c29 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:40.247556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:40.248299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:40.248672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:40.248944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:40.249600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:40.250969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:40.262347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:40.264197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 10 20:51:40.265073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:40.267200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 501/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:40.270373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabecae-2dab-4935-a65e-a5efa94ef9bc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:40.365042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eabecae-2dab-4935-a65e-a5efa94ef9bc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:40.397826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:40.398494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:40.398776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:40.399053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:40.399793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:40.400102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:40.401465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:40.411633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 513/1014] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:40.413174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:40.511421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319b092-9999-4b29-9033-9375a256c992 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:40.544998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa7c01-2b00-4d6e-a9d8-94b489787301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:40.545755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7c01-2b00-4d6e-a9d8-94b489787301 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:40.546298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7c01-2b00-4d6e-a9d8-94b489787301 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:40.546578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7c01-2b00-4d6e-a9d8-94b489787301 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:40.547317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa7c01-2b00-4d6e-a9d8-94b489787301 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:40.547628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa7c01-2b00-4d6e-a9d8-94b489787301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:40.549009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa7c01-2b00-4d6e-a9d8-94b489787301 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:40.554014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 502/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Tue May 10 20:51:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:40.559598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:40.656699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7aa1a1-1c07-4fdb-8c86-6a32f02b09fd None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:40.689702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9f72f-a8b1-490a-8f9e-e5310517368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:40.690358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9f72f-a8b1-490a-8f9e-e5310517368c None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:40.690641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9f72f-a8b1-490a-8f9e-e5310517368c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:40.690921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9f72f-a8b1-490a-8f9e-e5310517368c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:40.691703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9f72f-a8b1-490a-8f9e-e5310517368c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:40.693063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9f72f-a8b1-490a-8f9e-e5310517368c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:40.828072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 514/1016] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:51:41.939108 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893578-5d2c-4dd5-aca7-76e6f89e8e13 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:41.939693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893578-5d2c-4dd5-aca7-76e6f89e8e13 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:41.939693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893578-5d2c-4dd5-aca7-76e6f89e8e13 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:41.941237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 503/1017] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:41.946537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabacfc-cda8-415d-a63e-3cfc721b8051 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:41.946916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabacfc-cda8-415d-a63e-3cfc721b8051 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:41.947103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabacfc-cda8-415d-a63e-3cfc721b8051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:41.964093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bfabacfc-cda8-415d-a63e-3cfc721b8051 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:41.965281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bfabacfc-cda8-415d-a63e-3cfc721b8051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:42.036210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 515/1018] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:42.060263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91893578-5d2c-4dd5-aca7-76e6f89e8e13 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:42.097756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08e83-b4e8-4c52-97fc-e31e8ea40573 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.098045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08e83-b4e8-4c52-97fc-e31e8ea40573 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.098321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd08e83-b4e8-4c52-97fc-e31e8ea40573 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.099729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 516/1019] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:42.104694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e49a-94dd-4866-90c9-c597a1c8e3c9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.104983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e49a-94dd-4866-90c9-c597a1c8e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.105264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987e49a-94dd-4866-90c9-c597a1c8e3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.122441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4987e49a-94dd-4866-90c9-c597a1c8e3c9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:42.124235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4987e49a-94dd-4866-90c9-c597a1c8e3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:42.166206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91893578-5d2c-4dd5-aca7-76e6f89e8e13 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:42.190127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 517/1020] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:42.199090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:42.199901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.200177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.200446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.201629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:42.203064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:42.204676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 504/1021] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:42.210297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987e49a-94dd-4866-90c9-c597a1c8e3c9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:42.212755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:42.309550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987e49a-94dd-4866-90c9-c597a1c8e3c9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:42.311316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e10a3b-7aad-4ef0-a8a0-915bfc024150 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:42.343670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:42.344198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:42.344724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.344975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.345256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.345478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.345589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] PATH_INFO: `/v3/services/image` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.345982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.346167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:42.346987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:42.347563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:42.348705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:42.359014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:42.360240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:42.361335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:42.365069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 505/1022] 10.222.0.49 () {56 vars in 1105 bytes} [Tue May 10 20:51:42 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:42.365944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:42.444177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 518/1023] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:51:42 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:51:42.467501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79302e81-786f-4d22-b8aa-da31eae81e07 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:42.505062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:42.505752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.506037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.506318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.507050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] RBAC: Adding query filter params (name=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:42.507393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:42.508833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:42.515086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 506/1024] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:42.521179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:42.633317 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6051df-a77f-4bd2-8156-5c1ebcfb56be None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:42.667042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:42.667729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.668010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.668282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.668995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] RBAC: Adding query filter params (type=image) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:42.669296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:42.671599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:42.676598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 519/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:42.682574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:42.784639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397d097-3ae2-4564-8fda-c55e7a34e671 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:42.816970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996006-89c2-4003-a03e-f2d176114ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:42.817635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996006-89c2-4003-a03e-f2d176114ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.817921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996006-89c2-4003-a03e-f2d176114ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.818199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996006-89c2-4003-a03e-f2d176114ee1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.818995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996006-89c2-4003-a03e-f2d176114ee1 None admin] RBAC: Adding query filter params (interface=public, service_id=c442e6bef11e43718e3a2557203d98a8, region_id=RegionOne) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:42.819337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996006-89c2-4003-a03e-f2d176114ee1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:42.820722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996006-89c2-4003-a03e-f2d176114ee1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:42.830966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 507/1026] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:51:42 2022] GET /identity/v3/endpoints?service_id=c442e6bef11e43718e3a2557203d98a8&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:42.832559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:42.930466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba196a-c2fa-4f6e-9831-0252a2f75651 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:42.963924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050c0a-d4a3-449e-8188-dbf58ffb917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:42.964690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050c0a-d4a3-449e-8188-dbf58ffb917e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:42.964869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050c0a-d4a3-449e-8188-dbf58ffb917e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:42.965151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050c0a-d4a3-449e-8188-dbf58ffb917e None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:42.965843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050c0a-d4a3-449e-8188-dbf58ffb917e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:42.967387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10050c0a-d4a3-449e-8188-dbf58ffb917e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:42.979234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 520/1027] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:51:42 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:51:43.186685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3366-8784-4eaa-8bc3-0e62b1ecb06b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:43.187247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3366-8784-4eaa-8bc3-0e62b1ecb06b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:43.187341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e3366-8784-4eaa-8bc3-0e62b1ecb06b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:43.188651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 508/1028] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:43.194021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52a0a6-6220-4cc5-8843-0a0586e282a6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:43.194321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52a0a6-6220-4cc5-8843-0a0586e282a6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:43.194596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52a0a6-6220-4cc5-8843-0a0586e282a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:43.211344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0c52a0a6-6220-4cc5-8843-0a0586e282a6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:43.212529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0c52a0a6-6220-4cc5-8843-0a0586e282a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:43.280728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 521/1029] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:43.303559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e3366-8784-4eaa-8bc3-0e62b1ecb06b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:43.404845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e3366-8784-4eaa-8bc3-0e62b1ecb06b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:43.437866 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:43.438606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:43.438888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:43.439193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:43.449613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:43.458512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:43.459501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:43.460377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:43.463206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 509/1030] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 20:51:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:43.465742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52a0a6-6220-4cc5-8843-0a0586e282a6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:43.561347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52a0a6-6220-4cc5-8843-0a0586e282a6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:43.594293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:43.594969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:43.595287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:43.595569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:43.596326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:43.596637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:43.598004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:43.609221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 522/1031] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 20:51:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:43.614898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:43.713773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3273fa-1f5c-42c4-8ab6-87a20f11f958 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:43.747338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:43.748975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:43.748975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:43.749389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:43.759417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:43.760878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:43.778974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:43.780229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:43.787613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:43.787613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:43.787613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:43.787613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:43.787613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 510/1032] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:43.788064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:43.885602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe09bce-af88-4986-bbf9-9168a9b8520e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:43.918423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:43.919327 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:43.919797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:43.920783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:43.921902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:43.922372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:43.923928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:43.935255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 523/1033] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:43.941828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:44.038224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb468b-6ed7-4e94-8e14-84e44465ad44 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:44.071777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:44.072568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:44.072851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:44.073126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:44.080786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:44.082246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:44.095928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:44.096939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:44.097970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 511/1034] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:51:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:44.104838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:44.208211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656aedc5-04e1-4cb3-8ac8-b6b46e54132b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:44.242427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:44.243101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:44.243413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:44.243688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:44.244535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:44.244843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:44.246302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:44.265614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 524/1035] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:51:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:44.271152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:44.372209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764773-c183-46c4-be7b-f246f2e60f32 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:44.405662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaec42-77a0-479b-a200-f191ae1a04a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:44.406678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaec42-77a0-479b-a200-f191ae1a04a0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:44.407243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaec42-77a0-479b-a200-f191ae1a04a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:44.407724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaec42-77a0-479b-a200-f191ae1a04a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:44.473902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaec42-77a0-479b-a200-f191ae1a04a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:44.475791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baaec42-77a0-479b-a200-f191ae1a04a0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:44.573903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 512/1036] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:44 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:44.580073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:44.687086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6b855-54e4-4699-997f-57491cccb3d7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:44.720103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:44.724474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:44.724474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:44.724474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:44.731487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:44.733170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:44.746993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedb8e-e708-4376-962d-c9e2add857c1 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:44.747312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedb8e-e708-4376-962d-c9e2add857c1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:44.747593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dedb8e-e708-4376-962d-c9e2add857c1 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:44.749377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 513/1037] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:44.750895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:44.751819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:44.757579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:44.757579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:44.757579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:44.757579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:44.757579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 525/1038] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:44.757867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adcfa-a6d5-42c7-b0af-0a32d3e47463 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:44.757867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adcfa-a6d5-42c7-b0af-0a32d3e47463 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:44.757867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77adcfa-a6d5-42c7-b0af-0a32d3e47463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:44.758071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:44.774574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c77adcfa-a6d5-42c7-b0af-0a32d3e47463 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:44.775785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c77adcfa-a6d5-42c7-b0af-0a32d3e47463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:44.844600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 514/1039] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:44.857269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07304e96-69eb-47f5-8bdf-b8a7a0e0c6ac None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:44.869275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77adcfa-a6d5-42c7-b0af-0a32d3e47463 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:44.893221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:44.893997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:44.894279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:44.894563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:44.895344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:44.895651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:44.897010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:44.909122 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 526/1040] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:44.914402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:44.972243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77adcfa-a6d5-42c7-b0af-0a32d3e47463 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.006100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.006890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.007205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.007485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.008671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.010112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.011942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 515/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:45.017531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:45.022532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d28710-c291-4ab4-88d2-32f823000458 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.060325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.061984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.062266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.062540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.069646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.071092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:45.085198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:45.086285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:45.087368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 527/1042] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:45.092130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:45.124795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c54a6-231f-4b5a-ac60-09bf81c85877 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.158398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c462e-7304-4ff6-8273-1037386cc016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.159057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c462e-7304-4ff6-8273-1037386cc016 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.159365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c462e-7304-4ff6-8273-1037386cc016 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.159639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c462e-7304-4ff6-8273-1037386cc016 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.160336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c462e-7304-4ff6-8273-1037386cc016 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.161760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c462e-7304-4ff6-8273-1037386cc016 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.190228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36caf45-1dbf-4d3c-8fbf-4e79ef6b7c2d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.226671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfd18a-503e-46a2-9857-2ee5699b236b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.227278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfd18a-503e-46a2-9857-2ee5699b236b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.227560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfd18a-503e-46a2-9857-2ee5699b236b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.227834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfd18a-503e-46a2-9857-2ee5699b236b None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.228629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfd18a-503e-46a2-9857-2ee5699b236b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:45.228978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfd18a-503e-46a2-9857-2ee5699b236b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.230392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfd18a-503e-46a2-9857-2ee5699b236b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.241909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 528/1043] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:45.243179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212460b-e54b-4c9c-8155-ad5abc877d0e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.243476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212460b-e54b-4c9c-8155-ad5abc877d0e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.243754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212460b-e54b-4c9c-8155-ad5abc877d0e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.244993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 529/1044] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:45.247742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212460b-e54b-4c9c-8155-ad5abc877d0e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:45.260124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 516/1045] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:51:45 2022] POST /identity/v3/users => generated 285 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:51:45.260325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facbbb4-29e1-4bc5-a630-a58d9464a932 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.260614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facbbb4-29e1-4bc5-a630-a58d9464a932 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.260905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facbbb4-29e1-4bc5-a630-a58d9464a932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.279960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0facbbb4-29e1-4bc5-a630-a58d9464a932 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:45.281404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0facbbb4-29e1-4bc5-a630-a58d9464a932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:45.353735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 517/1046] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:45.358049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212460b-e54b-4c9c-8155-ad5abc877d0e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.377446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facbbb4-29e1-4bc5-a630-a58d9464a932 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:45.395170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.395840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.396150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.396393 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.397255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] RBAC: Adding query filter params (role.id=f22690693f0b45ea8144ac9a8767b01f, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=dd4bf9aaaae4483bade1570b1c1cfae7) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:45.397567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.399034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.415166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 530/1047] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:45 2022] GET /identity/v3/role_assignments?user.id=dd4bf9aaaae4483bade1570b1c1cfae7&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=f22690693f0b45ea8144ac9a8767b01f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:45.487577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facbbb4-29e1-4bc5-a630-a58d9464a932 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.526448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.527416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.527772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.528049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] PATH_INFO: `/v3/services/image` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.528719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.530196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:45.542899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:45.544123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:45.545648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 518/1048] 10.222.0.49 () {56 vars in 1105 bytes} [Tue May 10 20:51:45 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:45.551397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:45.653829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37dac-c564-4afc-a801-6482124636aa None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.687436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.688241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.688622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.688992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.689800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] RBAC: Adding query filter params (name=image) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:45.690204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.691681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.701599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 531/1049] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:45.702803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:45.803683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d6716-1ab0-40e8-b642-397efdaa672c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.836840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f642-f4d8-4ab5-b236-5c2a9c6b7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.837510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f642-f4d8-4ab5-b236-5c2a9c6b7ffa None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.837794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f642-f4d8-4ab5-b236-5c2a9c6b7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.838072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f642-f4d8-4ab5-b236-5c2a9c6b7ffa None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.838779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f642-f4d8-4ab5-b236-5c2a9c6b7ffa None admin] RBAC: Adding query filter params (type=image) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:45.839085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f642-f4d8-4ab5-b236-5c2a9c6b7ffa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.840492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f642-f4d8-4ab5-b236-5c2a9c6b7ffa None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:45.845748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 519/1050] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:45.851156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:45.949001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bfc3b0-3d2e-46d1-8905-d9fb3c317161 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:45.981315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810b81c0-dac9-4070-a5b8-95407ddaea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:45.981968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b81c0-dac9-4070-a5b8-95407ddaea9b None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:45.982276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b81c0-dac9-4070-a5b8-95407ddaea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:45.983541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810b81c0-dac9-4070-a5b8-95407ddaea9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:45.984039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b81c0-dac9-4070-a5b8-95407ddaea9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:45.985388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810b81c0-dac9-4070-a5b8-95407ddaea9b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:46.055287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 532/1051] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:51:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:51:47.580273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba6cd1-67e0-4cbd-9d7d-3f78048d7aca None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:47.580800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba6cd1-67e0-4cbd-9d7d-3f78048d7aca None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:47.580800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba6cd1-67e0-4cbd-9d7d-3f78048d7aca None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:47.582218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 520/1052] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:47.587511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9116-ce75-443e-af51-2c72e9e6ade7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:47.587939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9116-ce75-443e-af51-2c72e9e6ade7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:47.588110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf9116-ce75-443e-af51-2c72e9e6ade7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:47.605904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d2bf9116-ce75-443e-af51-2c72e9e6ade7 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:47.607109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d2bf9116-ce75-443e-af51-2c72e9e6ade7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:47.643157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059bfe-93ae-4bc6-89d9-562ad82281d6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:47.643498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059bfe-93ae-4bc6-89d9-562ad82281d6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:47.643721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059bfe-93ae-4bc6-89d9-562ad82281d6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:47.646429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 521/1053] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:47.650510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d8a09-41ee-4c44-8f1f-66e4310f4e4b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:47.650800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d8a09-41ee-4c44-8f1f-66e4310f4e4b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:47.651083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d8a09-41ee-4c44-8f1f-66e4310f4e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:47.668254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3b0d8a09-41ee-4c44-8f1f-66e4310f4e4b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:47.669478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3b0d8a09-41ee-4c44-8f1f-66e4310f4e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:47.680835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 533/1054] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:47.703888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf9116-ce75-443e-af51-2c72e9e6ade7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:47.740215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 522/1055] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:47.762628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d8a09-41ee-4c44-8f1f-66e4310f4e4b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:47.804844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf9116-ce75-443e-af51-2c72e9e6ade7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:47.838628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:47.839476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:47.839772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:47.840053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:47.851361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:47.859610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:47.860608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:47.862082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 534/1056] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:47.865134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d8a09-41ee-4c44-8f1f-66e4310f4e4b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:47.866564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:47.899362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:47.900176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:47.900461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:47.900740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:47.911997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:47.920797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:47.922102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:47.923234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 523/1057] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 20:51:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:47.928195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:47.972418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd5bd3-5c1b-4527-a106-530e5e942bda None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.005928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.006599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.006885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.007190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.007947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:48.008255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.009687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.017824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 535/1058] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:48.023496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.028037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec285b5-f695-4a04-b7d5-abd217b14283 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.064798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.065468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.066106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.066390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.067480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:48.068070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.069630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.079182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 524/1059] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 20:51:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:48.085031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.126361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2c812-0ba4-4b91-b02e-26ce70ac47e2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.160939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.161816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.162100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.162384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] PATH_INFO: `/v3/users/54f392a35fad47bb90b5b19fe0b2b0bf` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.177880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] RBAC: Authorizing `identity:get_user(user_id=54f392a35fad47bb90b5b19fe0b2b0bf)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.179414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.186272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 536/1060] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/users/54f392a35fad47bb90b5b19fe0b2b0bf => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:48.186933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.202744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c183bd-0f0a-42c5-b9eb-58af4ef4ff52 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.239224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.240023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.240307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.240585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.253170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.254638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:48.271753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:48.272897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:48.273858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:48.273858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:48.273858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:48.273858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:48.273858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 525/1061] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:48.278442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.293684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28296994-2b4b-4d38-988d-f3f785f5dee7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.327257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab475f2e-6af6-496a-8c02-57729f46aad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.327912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475f2e-6af6-496a-8c02-57729f46aad3 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.328205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475f2e-6af6-496a-8c02-57729f46aad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.328479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab475f2e-6af6-496a-8c02-57729f46aad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.387817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a497-57d0-40a8-a326-bcc3d9781554 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.395572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab475f2e-6af6-496a-8c02-57729f46aad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.397014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab475f2e-6af6-496a-8c02-57729f46aad3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.424377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af6ce2-c6c1-460a-a8d2-6da60f218779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.425039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6ce2-c6c1-460a-a8d2-6da60f218779 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.425385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6ce2-c6c1-460a-a8d2-6da60f218779 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.425666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af6ce2-c6c1-460a-a8d2-6da60f218779 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.426387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af6ce2-c6c1-460a-a8d2-6da60f218779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:48.426695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af6ce2-c6c1-460a-a8d2-6da60f218779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.428106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34af6ce2-c6c1-460a-a8d2-6da60f218779 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.441338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 526/1062] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:48.443467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3dd1-1730-44c7-88d9-23056245ed12 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.443827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3dd1-1730-44c7-88d9-23056245ed12 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.444098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f3dd1-1730-44c7-88d9-23056245ed12 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.445708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 527/1063] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:48.447141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3dd1-1730-44c7-88d9-23056245ed12 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.506154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 537/1064] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 10 20:51:48.508753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937120-73a7-42f9-ad00-dcc1e1c1e217 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.509045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937120-73a7-42f9-ad00-dcc1e1c1e217 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.509322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67937120-73a7-42f9-ad00-dcc1e1c1e217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.527874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-67937120-73a7-42f9-ad00-dcc1e1c1e217 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:48.529177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-67937120-73a7-42f9-ad00-dcc1e1c1e217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:48.549719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f3dd1-1730-44c7-88d9-23056245ed12 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.584522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.585318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.585599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.585874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.593830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.595306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:48.610824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:48.618082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 528/1065] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:48.619635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.620875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 538/1066] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:48.620875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937120-73a7-42f9-ad00-dcc1e1c1e217 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.731155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275867b8-a1d9-4318-b41c-3ec7a47a8d3e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.731456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67937120-73a7-42f9-ad00-dcc1e1c1e217 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.756815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.757677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.759833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.759833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.760168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.760275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] RBAC: Authorizing `identity:get_project(project_id=15aedd36e5f44970b15897a99e8d04a0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.760370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.760370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.760532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.760896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.761857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:48.762175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.763339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 529/1067] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:48.764929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.765458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.785261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 539/1068] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:48.786118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.870524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485248e-0b7d-4258-9896-de3e0d81d7a9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.891268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47dee7-4695-4e05-849c-37c143eb54df None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:48.906239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.906953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.907270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.907543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.925805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:48.926896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:48.927428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:48.927897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:48.928765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=15aedd36e5f44970b15897a99e8d04a0, user.id=54f392a35fad47bb90b5b19fe0b2b0bf) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:48.929193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.931281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:48.938488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 540/1069] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/role_assignments?user.id=54f392a35fad47bb90b5b19fe0b2b0bf&scope.project.id=15aedd36e5f44970b15897a99e8d04a0&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:48.939334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:48.984060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:48.985766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.065259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d806d65-80bd-4fad-84e7-5d1030b63498 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:49.098041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 530/1070] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:49.099259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:49.107989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:49.108941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:49.109224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:49.109491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:49.120329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:49.121929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:49.141683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:49.142643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:49.143616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:49.143616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:49.143616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:49.143616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:49.143616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 541/1071] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:49.149009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:49.204960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675f153-2670-4fb2-8ece-cf0103bb54cf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:49.242355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:49.243063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:49.243376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:49.243647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:49.246786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d4f7ab-3bb8-4c0f-bd6f-d586c8d7eeaf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:49.254181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:49.255682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:49.274030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:49.275182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:49.276121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:49.276121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:49.276121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:49.276121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:49.276121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 531/1072] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:49.281523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:49.286790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:49.287570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:49.287853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:49.288128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:49.288864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:49.289168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:49.290543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.302828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 542/1073] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:49.308330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:49.384917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660482eb-1b7c-47cb-86fb-ae8195fcfbf4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:49.408198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be543ad7-de96-4cad-9e71-7b0d90caf491 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:49.418995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:49.420192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:49.420640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:49.420996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:49.421964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:49.422281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:49.423703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.443186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 532/1074] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:49.444234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:49.445066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:49.445351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:49.445625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:49.456076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:49.457676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:49.473926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:49.474913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:49.480932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 543/1075] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:49.481440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:49.590168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb0283a-cd7a-457d-8972-aaab08a9c862 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:49.630602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90467503-08a5-4c0e-b8f3-0b8b5a6bff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:49.631294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467503-08a5-4c0e-b8f3-0b8b5a6bff00 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:49.631579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467503-08a5-4c0e-b8f3-0b8b5a6bff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:49.631855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467503-08a5-4c0e-b8f3-0b8b5a6bff00 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:49.632892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90467503-08a5-4c0e-b8f3-0b8b5a6bff00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:49.633004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90467503-08a5-4c0e-b8f3-0b8b5a6bff00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:49.634449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90467503-08a5-4c0e-b8f3-0b8b5a6bff00 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.647387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 533/1076] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:49.653522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:49.758693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dfcbf-594f-428b-93b2-49ece65c8e51 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:49.827703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff8c93-dc11-4110-91a3-b60918e2340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:49.828579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff8c93-dc11-4110-91a3-b60918e2340f None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:49.828861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff8c93-dc11-4110-91a3-b60918e2340f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:49.829134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff8c93-dc11-4110-91a3-b60918e2340f None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/dd4bf9aaaae4483bade1570b1c1cfae7/roles/f22690693f0b45ea8144ac9a8767b01f` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:49.831325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff8c93-dc11-4110-91a3-b60918e2340f None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=dd4bf9aaaae4483bade1570b1c1cfae7, role_id=f22690693f0b45ea8144ac9a8767b01f)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:49.832739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff8c93-dc11-4110-91a3-b60918e2340f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:49.898053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 544/1077] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:51:49 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/dd4bf9aaaae4483bade1570b1c1cfae7/roles/f22690693f0b45ea8144ac9a8767b01f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:51:51.190172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3018-e714-48b2-b7a9-e64706567f9a None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:51.190809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3018-e714-48b2-b7a9-e64706567f9a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:51.190809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb3018-e714-48b2-b7a9-e64706567f9a None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:51.192136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 534/1078] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:51.197492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8df27-a202-443f-a3b8-fc27e6f34a13 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:51.197933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8df27-a202-443f-a3b8-fc27e6f34a13 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:51.198033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8df27-a202-443f-a3b8-fc27e6f34a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:51.214150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7ad8df27-a202-443f-a3b8-fc27e6f34a13 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:51.215369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7ad8df27-a202-443f-a3b8-fc27e6f34a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:51.280779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 545/1079] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:51.304101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3018-e714-48b2-b7a9-e64706567f9a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:51.406846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb3018-e714-48b2-b7a9-e64706567f9a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:51.439685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:51.440521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:51.440876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:51.441152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:51.450756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:51.458339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:51.459568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:51.460694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 535/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:51.465445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8df27-a202-443f-a3b8-fc27e6f34a13 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:51.559551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8df27-a202-443f-a3b8-fc27e6f34a13 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:51.592485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:51.593158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:51.593446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:51.593721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:51.594471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:51.594776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:51.596176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:51.606325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 546/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:51.612265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:51.709440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46acf7-fbad-48a7-811e-98c3e31d3868 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:51.741965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:51.742864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:51.743168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:51.743447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] PATH_INFO: `/v3/users/54f392a35fad47bb90b5b19fe0b2b0bf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:51.744637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] RBAC: Authorizing `identity:get_user(user_id=54f392a35fad47bb90b5b19fe0b2b0bf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:51.746124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:51.752351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 536/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:51:51 2022] GET /identity/v3/users/54f392a35fad47bb90b5b19fe0b2b0bf => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:51.753672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:51.849839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed5a16-d662-44dd-ad79-c0c4bd48e42a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:51.882442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dabdd50-6500-4a66-a18c-9d6ee77c90fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:51.883328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabdd50-6500-4a66-a18c-9d6ee77c90fb None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:51.883616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabdd50-6500-4a66-a18c-9d6ee77c90fb None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:51.883894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabdd50-6500-4a66-a18c-9d6ee77c90fb None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:51.885073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabdd50-6500-4a66-a18c-9d6ee77c90fb None admin] RBAC: Authorizing `identity:get_project(project_id=15aedd36e5f44970b15897a99e8d04a0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:51.886508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dabdd50-6500-4a66-a18c-9d6ee77c90fb None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:51.888231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 547/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:51:51 2022] GET /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:51.894222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:51.997693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f527dc-66d7-4869-bae2-bfb32d2f38a9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:52.030709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:52.031618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:52.031897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:52.032169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0/users/54f392a35fad47bb90b5b19fe0b2b0bf/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:52.034087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=15aedd36e5f44970b15897a99e8d04a0, user_id=54f392a35fad47bb90b5b19fe0b2b0bf, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:52.035538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:52.098781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ebe-38a6-4e5d-a830-b88f5dc548ab None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:52.099135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ebe-38a6-4e5d-a830-b88f5dc548ab None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:52.099431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea68ebe-38a6-4e5d-a830-b88f5dc548ab None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:52.100797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 548/1084] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:51:52.105613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de961-6fca-4267-964d-b23f764b46ca None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:52.105903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de961-6fca-4267-964d-b23f764b46ca None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:52.106187 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3de961-6fca-4267-964d-b23f764b46ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:52.122395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ed3de961-6fca-4267-964d-b23f764b46ca None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:52.124193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ed3de961-6fca-4267-964d-b23f764b46ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:52.142352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 537/1085] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:51:51 2022] PUT /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0/users/54f392a35fad47bb90b5b19fe0b2b0bf/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:51:52.192850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 549/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:51:52.217731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:52.323729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c16caa-3e9f-4a77-aad3-f5e5659604c5 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:52.362820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:52.363670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:52.363956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:52.364229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:52.374151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:52.382243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:52.383277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:52.384168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 538/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Tue May 10 20:51:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:52.389891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de961-6fca-4267-964d-b23f764b46ca None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:52.484983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3de961-6fca-4267-964d-b23f764b46ca None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:52.518277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:52.518948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:52.519268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:52.519547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:52.520298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:52.520606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:52.521975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:52.529888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 550/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 20:51:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:52.535449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:52.646858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383296e-0411-4c3d-9d86-b730072e427b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:52.693945 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:52.694732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:52.695015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:52.695318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:52.710097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:52.711582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:52.729020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:52.729981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:52.730933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:52.730933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:52.730933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:52.730933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:52.730933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 539/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:52.736848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:52.882182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c38cec-1b3f-40b0-a11f-a0b8b597ef78 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:52.913452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:52.914107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:52.914387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:52.914659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:52.915414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:52.915713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:52.917063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:52.929615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 551/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:52.935086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:53.033323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1f3ba-35c5-4c28-ae78-0e100dadc0e2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:53.066931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:53.067807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:53.068089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:53.068363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:53.075506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:53.076971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:51:53.090245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:53.091434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 10 20:51:53.093220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:53.095278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 540/1091] 10.222.0.49 () {56 vars in 1093 bytes} [Tue May 10 20:51:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:53.097394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:53.191409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eeec9e-52e3-40d3-ac06-d18e4024e998 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:53.223591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:53.224251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:53.224530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:53.224802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:53.225635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:53.225940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:53.227447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:53.245596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 552/1092] 10.222.0.49 () {56 vars in 1133 bytes} [Tue May 10 20:51:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:53.252309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:53.359993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57204d-b7b4-48a4-ae1e-58e6b5b6acbc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:53.394885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:53.395551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:53.395836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:53.396113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:53.462401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:53.463829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:53.560011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 541/1093] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:53.566325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:53.662893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbdd3f4-4e51-46e8-a593-d563ed68ab3a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:53.696260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:53.697050 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:53.697334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:53.697608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:53.707535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:53.708978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:51:53.726508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:53.732128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:53.734047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:51:53.734047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:51:53.734047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:51:53.734047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:53.734047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 553/1094] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:53.734413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:53.841062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744bf0a-a46e-4415-9fb9-f0116c8cb701 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:53.873131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:53.873857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:53.874137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:53.874409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:53.875147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:53.875456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:53.876821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:53.888242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 542/1095] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:51:53.894534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:53.991974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12bd7cd-88cd-4ed2-8921-ffcc2ebd063b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:54.025313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:54.026099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.026377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.026648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.033938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:54.035391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:51:54.048841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:54.049905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:51:54.050935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 554/1096] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:51:54.055892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:54.151302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e0151-aa1d-488c-a3e2-dff9e6863583 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:54.185904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e994e-651e-4853-bafc-47f14d3e948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:54.186659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e994e-651e-4853-bafc-47f14d3e948a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.186955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e994e-651e-4853-bafc-47f14d3e948a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.187291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e994e-651e-4853-bafc-47f14d3e948a None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.188076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e994e-651e-4853-bafc-47f14d3e948a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:54.188391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e994e-651e-4853-bafc-47f14d3e948a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:54.189902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e994e-651e-4853-bafc-47f14d3e948a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:54.203861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 543/1097] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:54.209865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:54.304103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506dd4a-18ce-43c8-aebb-0c22412679d8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:54.336624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a85ea5-79d6-4c4a-9f4b-dcb25ce4e641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:54.337272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a85ea5-79d6-4c4a-9f4b-dcb25ce4e641 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.337553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a85ea5-79d6-4c4a-9f4b-dcb25ce4e641 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.337823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a85ea5-79d6-4c4a-9f4b-dcb25ce4e641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.338656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a85ea5-79d6-4c4a-9f4b-dcb25ce4e641 None admin] RBAC: Adding query filter params (role.id=f22690693f0b45ea8144ac9a8767b01f, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=dd4bf9aaaae4483bade1570b1c1cfae7) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:54.338965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a85ea5-79d6-4c4a-9f4b-dcb25ce4e641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:54.340598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a85ea5-79d6-4c4a-9f4b-dcb25ce4e641 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:54.346509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 555/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:54 2022] GET /identity/v3/role_assignments?user.id=dd4bf9aaaae4483bade1570b1c1cfae7&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=f22690693f0b45ea8144ac9a8767b01f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:54.366378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9e6c0-d64e-4ba7-94b7-6162b5bd9a1c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.366958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9e6c0-d64e-4ba7-94b7-6162b5bd9a1c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.367052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9e6c0-d64e-4ba7-94b7-6162b5bd9a1c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.368554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 544/1099] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:54.375850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40a6a-53a8-4d97-aed3-f8f848b416c5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.376145 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40a6a-53a8-4d97-aed3-f8f848b416c5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.376423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40a6a-53a8-4d97-aed3-f8f848b416c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.396123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5db40a6a-53a8-4d97-aed3-f8f848b416c5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:54.397375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5db40a6a-53a8-4d97-aed3-f8f848b416c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:54.469193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 556/1100] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:54.493323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9e6c0-d64e-4ba7-94b7-6162b5bd9a1c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:54.596010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9e6c0-d64e-4ba7-94b7-6162b5bd9a1c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:54.631002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:54.631895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.632174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.632447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.643150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:51:54.650638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:51:54.651632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:51:54.652489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 545/1101] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:51:54.658485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40a6a-53a8-4d97-aed3-f8f848b416c5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:54.757754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40a6a-53a8-4d97-aed3-f8f848b416c5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:54.820888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:54.821563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.821842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.822118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.822879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:54.823224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:54.824591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:54.832903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 557/1102] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:54.838790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:54.939291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c442cf1-5c58-4a56-99f3-ca89b14da2ab None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:54.972649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:54.973522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:54.973808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:54.974085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] PATH_INFO: `/v3/users/54f392a35fad47bb90b5b19fe0b2b0bf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:54.975350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] RBAC: Authorizing `identity:get_user(user_id=54f392a35fad47bb90b5b19fe0b2b0bf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:54.976798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:54.978587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 546/1103] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:51:54 2022] GET /identity/v3/users/54f392a35fad47bb90b5b19fe0b2b0bf => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:54.984835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:55.085460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb1e1f-7f4d-4537-8e55-32d9becc6c78 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:55.118117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:55.118771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:55.119057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:55.119365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:55.186848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:55.188308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:55.282983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 558/1104] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:51:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:51:55.288941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:55.390896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0fcc8-0620-4aec-a655-0165a2755aed None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:55.422722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ca922-6515-4606-bb83-b95852f9cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:55.423596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca922-6515-4606-bb83-b95852f9cb36 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:55.423875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca922-6515-4606-bb83-b95852f9cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:55.424145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ca922-6515-4606-bb83-b95852f9cb36 None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:55.425300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ca922-6515-4606-bb83-b95852f9cb36 None admin] RBAC: Authorizing `identity:get_project(project_id=15aedd36e5f44970b15897a99e8d04a0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:55.426739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32ca922-6515-4606-bb83-b95852f9cb36 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:55.428428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 547/1105] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:51:55 2022] GET /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:55.434469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:55.525902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5145c9-4f65-48b8-90ab-01ee09cdf7c6 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:55.557800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c57d-947b-46a8-b938-67c1b29d8fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:55.558372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c57d-947b-46a8-b938-67c1b29d8fea None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:55.558651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c57d-947b-46a8-b938-67c1b29d8fea None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:55.558924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c57d-947b-46a8-b938-67c1b29d8fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:55.559772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585c57d-947b-46a8-b938-67c1b29d8fea None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=15aedd36e5f44970b15897a99e8d04a0, user.id=54f392a35fad47bb90b5b19fe0b2b0bf) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:51:55.560081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585c57d-947b-46a8-b938-67c1b29d8fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:55.561582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585c57d-947b-46a8-b938-67c1b29d8fea None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:55.567057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 559/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:51:55 2022] GET /identity/v3/role_assignments?user.id=54f392a35fad47bb90b5b19fe0b2b0bf&scope.project.id=15aedd36e5f44970b15897a99e8d04a0&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:57.804194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517948-c60f-4b0e-b888-c9086cdf3ae0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:57.804739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517948-c60f-4b0e-b888-c9086cdf3ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:57.804739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517948-c60f-4b0e-b888-c9086cdf3ae0 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:57.806087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 548/1107] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:51:57.811551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a24d3-6576-472c-a6f0-f909a3b75ffd None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:57.811966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a24d3-6576-472c-a6f0-f909a3b75ffd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:57.812116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a24d3-6576-472c-a6f0-f909a3b75ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:57.828863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-700a24d3-6576-472c-a6f0-f909a3b75ffd None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:51:57.831044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-700a24d3-6576-472c-a6f0-f909a3b75ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:51:57.894905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 560/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:51:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:51:57.919480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517948-c60f-4b0e-b888-c9086cdf3ae0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:58.019175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517948-c60f-4b0e-b888-c9086cdf3ae0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:58.050607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379792f2-2152-4f19-9455-1379a421ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:58.051402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379792f2-2152-4f19-9455-1379a421ff90 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:58.051681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379792f2-2152-4f19-9455-1379a421ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:58.051950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379792f2-2152-4f19-9455-1379a421ff90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:58.053091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379792f2-2152-4f19-9455-1379a421ff90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:58.054528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379792f2-2152-4f19-9455-1379a421ff90 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:58.056136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 549/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:51:58.062434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a24d3-6576-472c-a6f0-f909a3b75ffd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:51:58.153643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a24d3-6576-472c-a6f0-f909a3b75ffd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:51:58.185102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd4ad4-2da3-4d7a-8add-6aa6a9e0dbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:51:58.186424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd4ad4-2da3-4d7a-8add-6aa6a9e0dbce None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:51:58.186700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd4ad4-2da3-4d7a-8add-6aa6a9e0dbce None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:51:58.186968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd4ad4-2da3-4d7a-8add-6aa6a9e0dbce None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:51:58.187712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd4ad4-2da3-4d7a-8add-6aa6a9e0dbce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:51:58.189118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dd4ad4-2da3-4d7a-8add-6aa6a9e0dbce None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:51:58.264757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 561/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:51:58 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:52:00.526259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d90bb-9055-4b99-8978-f86ce30d09b3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:00.526793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d90bb-9055-4b99-8978-f86ce30d09b3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:00.526793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077d90bb-9055-4b99-8978-f86ce30d09b3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:00.528180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 550/1111] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:00.535073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1ce3e-0f49-4d22-9b76-351c6c482f30 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:00.535511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1ce3e-0f49-4d22-9b76-351c6c482f30 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:00.535670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1ce3e-0f49-4d22-9b76-351c6c482f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:00.553058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-aed1ce3e-0f49-4d22-9b76-351c6c482f30 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:00.554245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-aed1ce3e-0f49-4d22-9b76-351c6c482f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:00.618617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 562/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:00.641813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d90bb-9055-4b99-8978-f86ce30d09b3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:00.737877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077d90bb-9055-4b99-8978-f86ce30d09b3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:00.770195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:00.771047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:00.771361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:00.771638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] PATH_INFO: `/v3/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:00.773096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] RBAC: Authorizing `identity:get_role(role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:00.774476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:00.775865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 551/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:00 2022] GET /identity/v3/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:00.782383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1ce3e-0f49-4d22-9b76-351c6c482f30 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:00.874541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1ce3e-0f49-4d22-9b76-351c6c482f30 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:00.906254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:00.907109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:00.907418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:00.907691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] PATH_INFO: `/v3/users/638eb3f7c90f43e9a8bd5f68f565a426` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:00.919903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] RBAC: Authorizing `identity:get_user(user_id=638eb3f7c90f43e9a8bd5f68f565a426)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:00.921648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:00.923286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 563/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:00 2022] GET /identity/v3/users/638eb3f7c90f43e9a8bd5f68f565a426 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:00.929126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:01.025073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91e784-dc9d-40ee-b8ae-93b709410308 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:01.057057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:01.057637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:01.057920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:01.058220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:01.121632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:01.123823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:01.217513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 552/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:52:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:52:01.223415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:01.317723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a8e20-b5ee-4a47-9f59-692896dda230 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:01.350202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29448a-556d-4da8-93ad-5b3f288fbd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:01.351049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29448a-556d-4da8-93ad-5b3f288fbd44 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:01.351362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29448a-556d-4da8-93ad-5b3f288fbd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:01.351642 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29448a-556d-4da8-93ad-5b3f288fbd44 None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:01.352821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29448a-556d-4da8-93ad-5b3f288fbd44 None admin] RBAC: Authorizing `identity:get_project(project_id=15aedd36e5f44970b15897a99e8d04a0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:01.354248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29448a-556d-4da8-93ad-5b3f288fbd44 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:01.355958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 564/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:01 2022] GET /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:01.362084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:01.456818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd76d0-4f18-45fe-9ec6-76a43454144e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:01.489409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b6d19-1ea1-4539-b0f4-8849ceb32566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:01.490037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6d19-1ea1-4539-b0f4-8849ceb32566 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:01.490316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6d19-1ea1-4539-b0f4-8849ceb32566 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:01.490589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b6d19-1ea1-4539-b0f4-8849ceb32566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:01.491429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b6d19-1ea1-4539-b0f4-8849ceb32566 None admin] RBAC: Adding query filter params (role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=15aedd36e5f44970b15897a99e8d04a0, user.id=638eb3f7c90f43e9a8bd5f68f565a426) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:01.491738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b6d19-1ea1-4539-b0f4-8849ceb32566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:01.493164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b6d19-1ea1-4539-b0f4-8849ceb32566 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:01.498429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 553/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:52:01 2022] GET /identity/v3/role_assignments?user.id=638eb3f7c90f43e9a8bd5f68f565a426&scope.project.id=15aedd36e5f44970b15897a99e8d04a0&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:03.666495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb5ba-d520-4e94-8b19-00e0420e32bf None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:03.666971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb5ba-d520-4e94-8b19-00e0420e32bf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:03.667061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5cb5ba-d520-4e94-8b19-00e0420e32bf None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:03.668419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 565/1118] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:03.674764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ae0d4-da95-4777-9f1c-c64b8d3968fa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:03.675222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ae0d4-da95-4777-9f1c-c64b8d3968fa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:03.675337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ae0d4-da95-4777-9f1c-c64b8d3968fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:03.692207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b69ae0d4-da95-4777-9f1c-c64b8d3968fa None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:03.693391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b69ae0d4-da95-4777-9f1c-c64b8d3968fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:03.757874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 554/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:03.780822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb5ba-d520-4e94-8b19-00e0420e32bf None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:03.875629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5cb5ba-d520-4e94-8b19-00e0420e32bf None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:03.907141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:03.907980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:03.908260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:03.908532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] PATH_INFO: `/v3/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:03.909977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] RBAC: Authorizing `identity:get_role(role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:03.911352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:03.912692 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 566/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:03 2022] GET /identity/v3/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:03.918253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ae0d4-da95-4777-9f1c-c64b8d3968fa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:04.014423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ae0d4-da95-4777-9f1c-c64b8d3968fa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:04.047174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:04.048034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:04.048312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:04.048580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] PATH_INFO: `/v3/users/638eb3f7c90f43e9a8bd5f68f565a426` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:04.049739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] RBAC: Authorizing `identity:get_user(user_id=638eb3f7c90f43e9a8bd5f68f565a426)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:04.051178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:04.052761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 555/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:03 2022] GET /identity/v3/users/638eb3f7c90f43e9a8bd5f68f565a426 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:04.058396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:04.152806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab6c92-8ee3-4b64-b9b4-46b8798b0db8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:04.184857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6612bf-a776-4d5e-b249-68c62eb50b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:04.186254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6612bf-a776-4d5e-b249-68c62eb50b74 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:04.186531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6612bf-a776-4d5e-b249-68c62eb50b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:04.186799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6612bf-a776-4d5e-b249-68c62eb50b74 None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:04.187990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6612bf-a776-4d5e-b249-68c62eb50b74 None admin] RBAC: Authorizing `identity:get_project(project_id=15aedd36e5f44970b15897a99e8d04a0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:04.189406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6612bf-a776-4d5e-b249-68c62eb50b74 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:04.191071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 567/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:04 2022] GET /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:04.197157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:04.292340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328510c4-4f55-47cf-bf83-4d6735969bdc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:04.325567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5c5ca-b434-4e37-b678-1804782f4242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:04.326522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5c5ca-b434-4e37-b678-1804782f4242 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:04.326806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5c5ca-b434-4e37-b678-1804782f4242 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:04.327079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5c5ca-b434-4e37-b678-1804782f4242 None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0/users/638eb3f7c90f43e9a8bd5f68f565a426/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:04.329297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5c5ca-b434-4e37-b678-1804782f4242 None admin] RBAC: Authorizing `identity:create_grant(project_id=15aedd36e5f44970b15897a99e8d04a0, user_id=638eb3f7c90f43e9a8bd5f68f565a426, role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:04.330728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5c5ca-b434-4e37-b678-1804782f4242 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:04.429319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 556/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:52:04 2022] PUT /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0/users/638eb3f7c90f43e9a8bd5f68f565a426/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:52:06.608230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6052-c490-4f07-b640-594ea186d18e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:06.608660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6052-c490-4f07-b640-594ea186d18e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:06.608781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c6052-c490-4f07-b640-594ea186d18e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:06.610151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 568/1124] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:06.615603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e593181-033b-44ab-a22d-82f32eca4e68 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:06.616015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e593181-033b-44ab-a22d-82f32eca4e68 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:06.616164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e593181-033b-44ab-a22d-82f32eca4e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:06.633160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5e593181-033b-44ab-a22d-82f32eca4e68 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:06.634331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5e593181-033b-44ab-a22d-82f32eca4e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:06.699228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 557/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:06.722618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c6052-c490-4f07-b640-594ea186d18e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:06.818190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c6052-c490-4f07-b640-594ea186d18e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:06.849421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:06.850256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:06.850534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:06.850804 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] PATH_INFO: `/v3/roles/6fac500bdeb340aa990c7117cf4ba148` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:06.852337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] RBAC: Authorizing `identity:get_role(role_id=6fac500bdeb340aa990c7117cf4ba148)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:06.853691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:06.855037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 569/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:06 2022] GET /identity/v3/roles/6fac500bdeb340aa990c7117cf4ba148 => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:06.861341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e593181-033b-44ab-a22d-82f32eca4e68 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:06.954766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e593181-033b-44ab-a22d-82f32eca4e68 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:06.986317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:06.987203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:06.987484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:06.987762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] PATH_INFO: `/v3/users/638eb3f7c90f43e9a8bd5f68f565a426` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:06.988934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] RBAC: Authorizing `identity:get_user(user_id=638eb3f7c90f43e9a8bd5f68f565a426)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:06.990360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:06.992002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 558/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:06 2022] GET /identity/v3/users/638eb3f7c90f43e9a8bd5f68f565a426 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:06.998095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:07.092194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894dce2-86ae-41d3-8e6f-d5b81f9c8df5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:07.123721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:07.124288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:07.124567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:07.124836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:07.187712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:07.189131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:07.280300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 570/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:52:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:52:07.286321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:07.380118 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc2180-07a9-4b01-b68b-9c2a3d4e9635 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:07.413147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b421f3-f8ff-4af1-bae5-13997b02fbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:07.413979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b421f3-f8ff-4af1-bae5-13997b02fbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:07.414258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b421f3-f8ff-4af1-bae5-13997b02fbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:07.414529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b421f3-f8ff-4af1-bae5-13997b02fbc9 None admin] PATH_INFO: `/v3/projects/15aedd36e5f44970b15897a99e8d04a0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:07.415699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b421f3-f8ff-4af1-bae5-13997b02fbc9 None admin] RBAC: Authorizing `identity:get_project(project_id=15aedd36e5f44970b15897a99e8d04a0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:07.417134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b421f3-f8ff-4af1-bae5-13997b02fbc9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:07.418783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 559/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:07 2022] GET /identity/v3/projects/15aedd36e5f44970b15897a99e8d04a0 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:07.425391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:07.518322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f7051-82c5-4faa-991b-2a128885ca7d None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:07.550572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0466ed20-4b9d-42ad-8ddd-ead1b945697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:07.551376 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ed20-4b9d-42ad-8ddd-ead1b945697e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:07.551668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ed20-4b9d-42ad-8ddd-ead1b945697e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:07.551946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0466ed20-4b9d-42ad-8ddd-ead1b945697e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:07.552779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466ed20-4b9d-42ad-8ddd-ead1b945697e None admin] RBAC: Adding query filter params (role.id=6fac500bdeb340aa990c7117cf4ba148, scope.project.id=15aedd36e5f44970b15897a99e8d04a0, user.id=638eb3f7c90f43e9a8bd5f68f565a426) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:07.553091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466ed20-4b9d-42ad-8ddd-ead1b945697e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:07.554511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0466ed20-4b9d-42ad-8ddd-ead1b945697e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:07.560188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 571/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:52:07 2022] GET /identity/v3/role_assignments?user.id=638eb3f7c90f43e9a8bd5f68f565a426&scope.project.id=15aedd36e5f44970b15897a99e8d04a0&role.id=6fac500bdeb340aa990c7117cf4ba148 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:09.766625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51ab2-9ed8-413e-8c51-033d3f4e626b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:09.767159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51ab2-9ed8-413e-8c51-033d3f4e626b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:09.767278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f51ab2-9ed8-413e-8c51-033d3f4e626b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:09.768547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 560/1131] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:09.773694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12284f0-2c19-483e-bd90-ad457d977b2e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:09.774071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12284f0-2c19-483e-bd90-ad457d977b2e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:09.774266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12284f0-2c19-483e-bd90-ad457d977b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:09.790777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b12284f0-2c19-483e-bd90-ad457d977b2e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:09.791992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b12284f0-2c19-483e-bd90-ad457d977b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:09.854662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 572/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:09.879455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51ab2-9ed8-413e-8c51-033d3f4e626b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:09.977797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f51ab2-9ed8-413e-8c51-033d3f4e626b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:10.010293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1273928-24c9-45fe-a9ed-bd0cfa3b2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:10.011060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1273928-24c9-45fe-a9ed-bd0cfa3b2684 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:10.011366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1273928-24c9-45fe-a9ed-bd0cfa3b2684 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:10.011638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1273928-24c9-45fe-a9ed-bd0cfa3b2684 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:10.012799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1273928-24c9-45fe-a9ed-bd0cfa3b2684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:10.015390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1273928-24c9-45fe-a9ed-bd0cfa3b2684 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:10.016972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 561/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:52:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:10.022817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12284f0-2c19-483e-bd90-ad457d977b2e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:10.115903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12284f0-2c19-483e-bd90-ad457d977b2e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:10.147706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5787ba8-f326-4cd0-8d6d-ad5ef41387a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:10.148292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5787ba8-f326-4cd0-8d6d-ad5ef41387a3 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:10.148573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5787ba8-f326-4cd0-8d6d-ad5ef41387a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:10.148851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5787ba8-f326-4cd0-8d6d-ad5ef41387a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:10.149548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5787ba8-f326-4cd0-8d6d-ad5ef41387a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:10.150957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5787ba8-f326-4cd0-8d6d-ad5ef41387a3 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:10.249788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 573/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:52:10 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:52:12.500840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95a264-b09c-45a7-acc2-1b6b3856d47f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:12.501420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95a264-b09c-45a7-acc2-1b6b3856d47f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:12.501420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95a264-b09c-45a7-acc2-1b6b3856d47f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:12.502750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 562/1135] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:52:12.508046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905f3f5-5524-4961-9d83-267dba9462cc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:12.508484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905f3f5-5524-4961-9d83-267dba9462cc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:12.508610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905f3f5-5524-4961-9d83-267dba9462cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:12.525384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4905f3f5-5524-4961-9d83-267dba9462cc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:12.526563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4905f3f5-5524-4961-9d83-267dba9462cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:12.589970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 574/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:12.614736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95a264-b09c-45a7-acc2-1b6b3856d47f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:12.713267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95a264-b09c-45a7-acc2-1b6b3856d47f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:12.746001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3302a43-9d0f-46d2-946b-b9833fea8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:12.746790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302a43-9d0f-46d2-946b-b9833fea8e02 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:12.747073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302a43-9d0f-46d2-946b-b9833fea8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:12.747385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3302a43-9d0f-46d2-946b-b9833fea8e02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:12.749305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3302a43-9d0f-46d2-946b-b9833fea8e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:12.750834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3302a43-9d0f-46d2-946b-b9833fea8e02 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:12.752538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 563/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:12.758148 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905f3f5-5524-4961-9d83-267dba9462cc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:12.850573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905f3f5-5524-4961-9d83-267dba9462cc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:12.882856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb0369-7d5a-4929-9aa5-0aeea07712e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:12.883538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0369-7d5a-4929-9aa5-0aeea07712e5 None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:12.883822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0369-7d5a-4929-9aa5-0aeea07712e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:12.884098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb0369-7d5a-4929-9aa5-0aeea07712e5 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:12.884809 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0369-7d5a-4929-9aa5-0aeea07712e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:12.886218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb0369-7d5a-4929-9aa5-0aeea07712e5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:12.962538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 575/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:52:12 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:52:15.191996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37231b71-12b9-4a6a-b530-96d407c94e27 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:15.192549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37231b71-12b9-4a6a-b530-96d407c94e27 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:15.192549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37231b71-12b9-4a6a-b530-96d407c94e27 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:15.193951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 564/1139] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:15.199016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b8ede-bbbc-422b-a3e2-f14028706033 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:15.199454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b8ede-bbbc-422b-a3e2-f14028706033 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:15.199612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b8ede-bbbc-422b-a3e2-f14028706033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:15.215759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1b8b8ede-bbbc-422b-a3e2-f14028706033 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:15.217515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1b8b8ede-bbbc-422b-a3e2-f14028706033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:15.279808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 576/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:15.303375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37231b71-12b9-4a6a-b530-96d407c94e27 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:15.398534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37231b71-12b9-4a6a-b530-96d407c94e27 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:15.431648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:15.432421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:15.432707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:15.432986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:15.442906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:52:15.450375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:52:15.451775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:52:15.452835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 565/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:52:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:52:15.457513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b8ede-bbbc-422b-a3e2-f14028706033 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:15.550760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b8ede-bbbc-422b-a3e2-f14028706033 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:15.584526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:15.585179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:15.585461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:15.585738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:15.586479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:15.586787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:15.588184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:15.595896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 577/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:52:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:15.601679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:15.698302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171586-2657-4ae4-9678-4a3a9738bd00 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:15.729799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:15.730652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:15.730937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:15.731245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] PATH_INFO: `/v3/users/445f905c060d40c88777b087f5340f07` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:15.744568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] RBAC: Authorizing `identity:get_user(user_id=445f905c060d40c88777b087f5340f07)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:15.746050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:15.748357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 566/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:15 2022] GET /identity/v3/users/445f905c060d40c88777b087f5340f07 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:15.754244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:15.886634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930a158-2e45-4175-9687-80fb3ca8d775 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:15.918339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:15.918978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:15.919882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:15.920163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:15.983885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:15.985275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:16.077777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 578/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:52:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:52:16.083641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:16.176611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6efc1d-3d50-4d43-9fcf-b6c4cd011b3c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:16.208527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27aad5-1c03-4b0e-901b-839112a93316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:16.209367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aad5-1c03-4b0e-901b-839112a93316 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:16.209645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aad5-1c03-4b0e-901b-839112a93316 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:16.209917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27aad5-1c03-4b0e-901b-839112a93316 None admin] PATH_INFO: `/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:16.211068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27aad5-1c03-4b0e-901b-839112a93316 None admin] RBAC: Authorizing `identity:get_project(project_id=5c6d034d66684b6e8b88a4ecea358ee4)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:16.212514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27aad5-1c03-4b0e-901b-839112a93316 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:16.214163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 567/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:16 2022] GET /identity/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:16.220647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:16.313249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73097b4a-f033-4f6e-9126-de075d7f9533 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:16.345160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d95fa98-0208-440f-b3c6-5d96995ec349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:16.345799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95fa98-0208-440f-b3c6-5d96995ec349 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:16.346083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95fa98-0208-440f-b3c6-5d96995ec349 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:16.346359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95fa98-0208-440f-b3c6-5d96995ec349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:16.347217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95fa98-0208-440f-b3c6-5d96995ec349 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=5c6d034d66684b6e8b88a4ecea358ee4, user.id=445f905c060d40c88777b087f5340f07) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:16.347535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95fa98-0208-440f-b3c6-5d96995ec349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:16.348981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d95fa98-0208-440f-b3c6-5d96995ec349 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:16.354167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 579/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:52:16 2022] GET /identity/v3/role_assignments?user.id=445f905c060d40c88777b087f5340f07&scope.project.id=5c6d034d66684b6e8b88a4ecea358ee4&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:18.521304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794094-fd64-4f72-8904-9a19575937e2 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:18.521839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794094-fd64-4f72-8904-9a19575937e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:18.521839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b794094-fd64-4f72-8904-9a19575937e2 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:18.523209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 568/1147] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:18.528295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829945-f69f-4b79-993e-63d135582a78 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:18.528676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829945-f69f-4b79-993e-63d135582a78 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:18.528885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5829945-f69f-4b79-993e-63d135582a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:18.546716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c5829945-f69f-4b79-993e-63d135582a78 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:18.547939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c5829945-f69f-4b79-993e-63d135582a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:18.612379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 580/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:18.633943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b794094-fd64-4f72-8904-9a19575937e2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:18.736434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b794094-fd64-4f72-8904-9a19575937e2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:18.768574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:18.769358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:18.769640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:18.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:18.780566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:52:18.787950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:52:18.789052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:52:18.790073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 569/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:52:18.795522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829945-f69f-4b79-993e-63d135582a78 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:18.887629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5829945-f69f-4b79-993e-63d135582a78 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:18.918880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:18.919719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:18.919997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:18.920267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:18.921069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:18.921378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:18.922986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:18.930515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 581/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:18.937144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:19.032244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4f18a-c836-428b-95a1-d1a90ebc14ec None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:19.064087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:19.064928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:19.065204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:19.065475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] PATH_INFO: `/v3/users/445f905c060d40c88777b087f5340f07` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:19.066632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=445f905c060d40c88777b087f5340f07)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:19.068101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:19.069692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 570/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:18 2022] GET /identity/v3/users/445f905c060d40c88777b087f5340f07 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:19.075321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:19.168253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805420e7-eed8-459a-8748-0517dfed8573 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:19.200107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f87676-85ed-4cb3-9dca-0261cff92825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:19.201630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87676-85ed-4cb3-9dca-0261cff92825 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:19.201914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87676-85ed-4cb3-9dca-0261cff92825 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:19.202186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f87676-85ed-4cb3-9dca-0261cff92825 None admin] PATH_INFO: `/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:19.203369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f87676-85ed-4cb3-9dca-0261cff92825 None admin] RBAC: Authorizing `identity:get_project(project_id=5c6d034d66684b6e8b88a4ecea358ee4)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:19.204777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f87676-85ed-4cb3-9dca-0261cff92825 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:19.206427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 582/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:19 2022] GET /identity/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:19.212090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:19.312570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21335e6-25d2-413d-9245-94374a22b6d9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:19.344682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfea92-ff30-4e8c-b442-dcfa5a0c3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:19.345544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfea92-ff30-4e8c-b442-dcfa5a0c3381 None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:19.345825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfea92-ff30-4e8c-b442-dcfa5a0c3381 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:19.346102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfea92-ff30-4e8c-b442-dcfa5a0c3381 None admin] PATH_INFO: `/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4/users/445f905c060d40c88777b087f5340f07/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:19.348053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfea92-ff30-4e8c-b442-dcfa5a0c3381 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c6d034d66684b6e8b88a4ecea358ee4, user_id=445f905c060d40c88777b087f5340f07, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:19.349480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfea92-ff30-4e8c-b442-dcfa5a0c3381 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:19.442616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 571/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:52:19 2022] PUT /identity/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4/users/445f905c060d40c88777b087f5340f07/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 20:52:21.621167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3353c85-bd50-4de4-adec-300768c3dc8d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:21.621619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3353c85-bd50-4de4-adec-300768c3dc8d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:21.621722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3353c85-bd50-4de4-adec-300768c3dc8d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:21.624063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 583/1154] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:21.629362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7cb4-ebea-4a06-9815-daeb3605756a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:21.629801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7cb4-ebea-4a06-9815-daeb3605756a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:21.629920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfd7cb4-ebea-4a06-9815-daeb3605756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:21.646385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2cfd7cb4-ebea-4a06-9815-daeb3605756a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:21.647606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2cfd7cb4-ebea-4a06-9815-daeb3605756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:21.711396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 572/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:21.735913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3353c85-bd50-4de4-adec-300768c3dc8d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:21.834224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3353c85-bd50-4de4-adec-300768c3dc8d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:21.865451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:21.866172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:21.866452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:21.866722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:21.877214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:52:21.884569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:52:21.885743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:52:21.886893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 584/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:52:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:52:21.891857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7cb4-ebea-4a06-9815-daeb3605756a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:21.987443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfd7cb4-ebea-4a06-9815-daeb3605756a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:22.020015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:22.020680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:22.020960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:22.021233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:22.021973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:22.022279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:22.023687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:22.032386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 573/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:52:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:22.038114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:22.132775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218ea8c-716c-45d6-a617-f5c5006ff350 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:22.164726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:22.165578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:22.165858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:22.166131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] PATH_INFO: `/v3/users/445f905c060d40c88777b087f5340f07` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:22.167333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] RBAC: Authorizing `identity:get_user(user_id=445f905c060d40c88777b087f5340f07)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:22.168765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:22.170964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 585/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:22 2022] GET /identity/v3/users/445f905c060d40c88777b087f5340f07 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:22.176950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:22.271137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d9bf4-c1bb-45f8-9343-32c5ebd0a49d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:22.303140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:22.303775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:22.304055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:22.304328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:22.367420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:22.368863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:22.460643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 574/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:52:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:52:22.467087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:22.560363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364bc79-d7ca-4889-bc8e-b9fc1fbef605 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:22.592051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f19f1e2-df22-4584-ba82-5f1646bac74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:22.592896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19f1e2-df22-4584-ba82-5f1646bac74c None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:22.593179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19f1e2-df22-4584-ba82-5f1646bac74c None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:22.593473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f19f1e2-df22-4584-ba82-5f1646bac74c None admin] PATH_INFO: `/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:22.594631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19f1e2-df22-4584-ba82-5f1646bac74c None admin] RBAC: Authorizing `identity:get_project(project_id=5c6d034d66684b6e8b88a4ecea358ee4)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:22.596084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f19f1e2-df22-4584-ba82-5f1646bac74c None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:22.597754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 586/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:22 2022] GET /identity/v3/projects/5c6d034d66684b6e8b88a4ecea358ee4 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:22.603905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:22.701526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e376e-1afe-45e8-9402-b5103d7fa9f8 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:22.735278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c7c006-170d-470b-ae47-19d607197529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:22.735862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c006-170d-470b-ae47-19d607197529 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:22.736143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c006-170d-470b-ae47-19d607197529 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:22.736419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c7c006-170d-470b-ae47-19d607197529 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:22.737321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7c006-170d-470b-ae47-19d607197529 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=5c6d034d66684b6e8b88a4ecea358ee4, user.id=445f905c060d40c88777b087f5340f07) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:22.737631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7c006-170d-470b-ae47-19d607197529 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:22.739054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c7c006-170d-470b-ae47-19d607197529 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:22.744638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 575/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:52:22 2022] GET /identity/v3/role_assignments?user.id=445f905c060d40c88777b087f5340f07&scope.project.id=5c6d034d66684b6e8b88a4ecea358ee4&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:24.969683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8e69-996b-40ae-86dc-b17c4d75691d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:24.970213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8e69-996b-40ae-86dc-b17c4d75691d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:24.970213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b8e69-996b-40ae-86dc-b17c4d75691d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:24.971557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 587/1162] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:24.976651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e214c-6e14-44a0-9201-ba0040d01ffb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:24.977075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e214c-6e14-44a0-9201-ba0040d01ffb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:24.977210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e214c-6e14-44a0-9201-ba0040d01ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:24.993530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4a7e214c-6e14-44a0-9201-ba0040d01ffb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:24.994712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4a7e214c-6e14-44a0-9201-ba0040d01ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:25.058424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 576/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:25.081648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b8e69-996b-40ae-86dc-b17c4d75691d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:25.179008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b8e69-996b-40ae-86dc-b17c4d75691d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:25.212264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:25.212896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:25.213179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:25.213454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:25.277460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:25.279911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:25.373117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 588/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:52:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:52:25.379027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e214c-6e14-44a0-9201-ba0040d01ffb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:25.472272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e214c-6e14-44a0-9201-ba0040d01ffb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:25.503714 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f9577-144e-4333-a8fe-b2650525231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:25.504495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9577-144e-4333-a8fe-b2650525231f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:25.504776 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9577-144e-4333-a8fe-b2650525231f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:25.505049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f9577-144e-4333-a8fe-b2650525231f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:25.511500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9577-144e-4333-a8fe-b2650525231f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:25.513501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f9577-144e-4333-a8fe-b2650525231f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-f02f9577-144e-4333-a8fe-b2650525231f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:52:25.527031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:52:25.528323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:52:25.529457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 577/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:52:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:52:25.534128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:25.628434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237af54-1c0a-47fb-b146-9357cbb89068 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:25.661108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8de71c-db52-49aa-bd66-e455041c766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:25.661758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8de71c-db52-49aa-bd66-e455041c766b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:25.662041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8de71c-db52-49aa-bd66-e455041c766b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:25.662316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8de71c-db52-49aa-bd66-e455041c766b None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:25.663036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8de71c-db52-49aa-bd66-e455041c766b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:25.663370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8de71c-db52-49aa-bd66-e455041c766b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:25.664721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8de71c-db52-49aa-bd66-e455041c766b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:25.673403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 589/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Tue May 10 20:52:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:27.877163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d265-98a1-4914-a264-ab36eef8a352 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:27.877659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d265-98a1-4914-a264-ab36eef8a352 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:27.877659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d265-98a1-4914-a264-ab36eef8a352 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:27.878985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 578/1167] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:27.884333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f94d-3a13-490a-a01b-5836e4a30324 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:27.884743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f94d-3a13-490a-a01b-5836e4a30324 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:27.884889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9f94d-3a13-490a-a01b-5836e4a30324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:27.901514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6ef9f94d-3a13-490a-a01b-5836e4a30324 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:27.902707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6ef9f94d-3a13-490a-a01b-5836e4a30324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:27.967099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 590/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:27.990029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d265-98a1-4914-a264-ab36eef8a352 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:28.088514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d265-98a1-4914-a264-ab36eef8a352 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:28.121471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bba95-cc30-490d-ab93-dab9acc514af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:28.122138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bba95-cc30-490d-ab93-dab9acc514af None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:28.122842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bba95-cc30-490d-ab93-dab9acc514af None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:28.123150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bba95-cc30-490d-ab93-dab9acc514af None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:28.123904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bba95-cc30-490d-ab93-dab9acc514af None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:28.125267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bba95-cc30-490d-ab93-dab9acc514af None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:28.226913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 579/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Tue May 10 20:52:27 2022] POST /identity/v3/domains => generated 267 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:52:30.452303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93047e11-1824-47d0-8a09-415ec70ea0f0 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:30.452871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93047e11-1824-47d0-8a09-415ec70ea0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:30.452871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93047e11-1824-47d0-8a09-415ec70ea0f0 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:30.454203 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 591/1170] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:30.459349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acea84-92c6-40e7-83b9-75c22fff9de2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:30.459770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acea84-92c6-40e7-83b9-75c22fff9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:30.459911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23acea84-92c6-40e7-83b9-75c22fff9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:30.477693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-23acea84-92c6-40e7-83b9-75c22fff9de2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:30.478870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-23acea84-92c6-40e7-83b9-75c22fff9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:30.543202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 580/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:30.566397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93047e11-1824-47d0-8a09-415ec70ea0f0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:30.662590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93047e11-1824-47d0-8a09-415ec70ea0f0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:30.694240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836d0647-f1a3-402d-8230-45de2abce868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:30.695088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0647-f1a3-402d-8230-45de2abce868 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:30.695404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0647-f1a3-402d-8230-45de2abce868 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:30.695679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836d0647-f1a3-402d-8230-45de2abce868 None admin] PATH_INFO: `/v3/domains/4a5f1238ec86417692186882724a393a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:30.706601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d0647-f1a3-402d-8230-45de2abce868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4a5f1238ec86417692186882724a393a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:30.708007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836d0647-f1a3-402d-8230-45de2abce868 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:30.709629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 592/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Tue May 10 20:52:30 2022] GET /identity/v3/domains/4a5f1238ec86417692186882724a393a => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:30.715554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acea84-92c6-40e7-83b9-75c22fff9de2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:30.812146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23acea84-92c6-40e7-83b9-75c22fff9de2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:30.843678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e61f7-ee8a-4769-8023-30e8647d390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:30.844317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e61f7-ee8a-4769-8023-30e8647d390b None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:30.844595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e61f7-ee8a-4769-8023-30e8647d390b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:30.844870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e61f7-ee8a-4769-8023-30e8647d390b None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:30.845577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e61f7-ee8a-4769-8023-30e8647d390b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:30.846992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e61f7-ee8a-4769-8023-30e8647d390b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:30.946700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 581/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:52:30 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 20:52:33.176118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ed9e-fa06-431b-91d8-1587ffe4d16a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:33.176755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ed9e-fa06-431b-91d8-1587ffe4d16a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:33.176755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46ed9e-fa06-431b-91d8-1587ffe4d16a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:33.178044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 593/1174] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:33.183377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86edbff-5cbb-47e9-af0a-14f3e5bdf6df None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:33.183795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86edbff-5cbb-47e9-af0a-14f3e5bdf6df None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:33.183933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86edbff-5cbb-47e9-af0a-14f3e5bdf6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:33.201485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d86edbff-5cbb-47e9-af0a-14f3e5bdf6df None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:33.202639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d86edbff-5cbb-47e9-af0a-14f3e5bdf6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:33.265500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 582/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:33.289557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ed9e-fa06-431b-91d8-1587ffe4d16a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:33.386369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46ed9e-fa06-431b-91d8-1587ffe4d16a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:33.417851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94ec75-b9b6-4efc-b6d4-3f8b57a4716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:33.418728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94ec75-b9b6-4efc-b6d4-3f8b57a4716f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:33.419082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94ec75-b9b6-4efc-b6d4-3f8b57a4716f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:33.419453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94ec75-b9b6-4efc-b6d4-3f8b57a4716f None admin] PATH_INFO: `/v3/domains/4a5f1238ec86417692186882724a393a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:33.420740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94ec75-b9b6-4efc-b6d4-3f8b57a4716f None admin] RBAC: Authorizing `identity:get_domain(domain_id=4a5f1238ec86417692186882724a393a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:33.422437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94ec75-b9b6-4efc-b6d4-3f8b57a4716f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:33.424115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 594/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Tue May 10 20:52:33 2022] GET /identity/v3/domains/4a5f1238ec86417692186882724a393a => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:33.429869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86edbff-5cbb-47e9-af0a-14f3e5bdf6df None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:33.522992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86edbff-5cbb-47e9-af0a-14f3e5bdf6df None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:33.554891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad29a9-b766-4629-b52b-bf3ef16554fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:33.555564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad29a9-b766-4629-b52b-bf3ef16554fe None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:33.555844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad29a9-b766-4629-b52b-bf3ef16554fe None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:33.556117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad29a9-b766-4629-b52b-bf3ef16554fe None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:33.556809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad29a9-b766-4629-b52b-bf3ef16554fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:33.558222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad29a9-b766-4629-b52b-bf3ef16554fe None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:33.659984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 583/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:52:33 2022] POST /identity/v3/users => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:52:35.901914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9196-f730-45f3-9b23-82ce77805c67 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:35.902445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9196-f730-45f3-9b23-82ce77805c67 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:35.902445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb9196-f730-45f3-9b23-82ce77805c67 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:35.904382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 595/1178] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:35.909582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7685d2-07d0-4616-8e33-169c68860d2b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:35.910000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7685d2-07d0-4616-8e33-169c68860d2b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:35.910144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7685d2-07d0-4616-8e33-169c68860d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:35.926793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4c7685d2-07d0-4616-8e33-169c68860d2b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:35.928013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c7685d2-07d0-4616-8e33-169c68860d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:35.990871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 584/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:36.014609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9196-f730-45f3-9b23-82ce77805c67 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:36.111015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb9196-f730-45f3-9b23-82ce77805c67 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:36.142479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:36.143287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:36.143574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:36.143850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:36.154441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:52:36.161915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:52:36.163052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:36.164204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:52:36.167914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 596/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:52:36.169790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7685d2-07d0-4616-8e33-169c68860d2b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:36.262580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7685d2-07d0-4616-8e33-169c68860d2b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:36.295536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:36.296185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:36.296468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:36.297007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:36.297761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:36.298069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:36.299477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:36.307158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 585/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:36.313053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:36.405626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd20c-0d2a-426b-b0ba-2011d73fe8f4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:36.438275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:36.439113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:36.439422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:36.439736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] PATH_INFO: `/v3/users/2704372244f94691855019d7f075f684` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:36.451967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=2704372244f94691855019d7f075f684)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:36.453386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:36.454974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 597/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:36 2022] GET /identity/v3/users/2704372244f94691855019d7f075f684 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:36.460620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:36.558079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b195d-ef37-4c73-a54a-d1675095d8b0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:36.589544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:36.590173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:36.590453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:36.590788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:36.654700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:36.656231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:36.748457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 586/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:52:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:52:36.754375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:36.850164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73047c-eb23-4dec-989e-e35c6a99e2b0 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:36.881851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca139c5f-7a2e-4847-b5ce-7fc016a160ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:36.882690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139c5f-7a2e-4847-b5ce-7fc016a160ec None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:36.882969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139c5f-7a2e-4847-b5ce-7fc016a160ec None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:36.883270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca139c5f-7a2e-4847-b5ce-7fc016a160ec None admin] PATH_INFO: `/v3/projects/7729f64589014cfc9c1cab6be247edd6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:36.884428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca139c5f-7a2e-4847-b5ce-7fc016a160ec None admin] RBAC: Authorizing `identity:get_project(project_id=7729f64589014cfc9c1cab6be247edd6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:36.885852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca139c5f-7a2e-4847-b5ce-7fc016a160ec None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:36.887640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 598/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:36 2022] GET /identity/v3/projects/7729f64589014cfc9c1cab6be247edd6 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:36.893552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:36.986602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8231c8-4dea-45b0-b11c-9c43f96335de None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:37.018469 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cde93-3f6a-47db-8a15-2df8bc4836b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:37.019100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cde93-3f6a-47db-8a15-2df8bc4836b2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:37.019409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cde93-3f6a-47db-8a15-2df8bc4836b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:37.019687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cde93-3f6a-47db-8a15-2df8bc4836b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:37.020505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cde93-3f6a-47db-8a15-2df8bc4836b2 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=7729f64589014cfc9c1cab6be247edd6, user.id=2704372244f94691855019d7f075f684) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:37.020813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cde93-3f6a-47db-8a15-2df8bc4836b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:37.022226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cde93-3f6a-47db-8a15-2df8bc4836b2 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:37.027397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 587/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:52:36 2022] GET /identity/v3/role_assignments?user.id=2704372244f94691855019d7f075f684&scope.project.id=7729f64589014cfc9c1cab6be247edd6&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:39.196614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e97939-2a30-419a-9e66-b1109bdcbff6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:39.197146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e97939-2a30-419a-9e66-b1109bdcbff6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:39.197146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e97939-2a30-419a-9e66-b1109bdcbff6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:39.198516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 599/1186] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:39.203757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa4c6-f099-4bea-aa1a-d17ae3f7e3db None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:39.204182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa4c6-f099-4bea-aa1a-d17ae3f7e3db None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:39.204290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fa4c6-f099-4bea-aa1a-d17ae3f7e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:39.220924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-839fa4c6-f099-4bea-aa1a-d17ae3f7e3db None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:39.222103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-839fa4c6-f099-4bea-aa1a-d17ae3f7e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:39.284349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 588/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:39.307109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e97939-2a30-419a-9e66-b1109bdcbff6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:39.401668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e97939-2a30-419a-9e66-b1109bdcbff6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:39.433961 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:39.435315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:39.435725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:39.436043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:39.445885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:52:39.454273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:52:39.455281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:52:39.456199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 600/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:52:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:52:39.461340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa4c6-f099-4bea-aa1a-d17ae3f7e3db None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:39.566157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fa4c6-f099-4bea-aa1a-d17ae3f7e3db None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:39.599224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:39.599897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:39.600183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:39.600463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:39.601248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:39.601558 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:39.602964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:39.611139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 589/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:39.616857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:39.710500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f758e8f-2e10-4035-8cfd-97fdcbb5a8ee None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:39.741825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:39.742672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:39.742957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:39.743260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] PATH_INFO: `/v3/users/2704372244f94691855019d7f075f684` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:39.744431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] RBAC: Authorizing `identity:get_user(user_id=2704372244f94691855019d7f075f684)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:39.745839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:39.747735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 601/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:39 2022] GET /identity/v3/users/2704372244f94691855019d7f075f684 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:39.753341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:39.854042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def5b62-da6b-4f59-a3ee-8ac697a3386b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:39.886635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbefd87-def2-4523-92d8-d9d020c490f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:39.888124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbefd87-def2-4523-92d8-d9d020c490f5 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:39.888524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbefd87-def2-4523-92d8-d9d020c490f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:39.888912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbefd87-def2-4523-92d8-d9d020c490f5 None admin] PATH_INFO: `/v3/projects/7729f64589014cfc9c1cab6be247edd6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:39.890110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbefd87-def2-4523-92d8-d9d020c490f5 None admin] RBAC: Authorizing `identity:get_project(project_id=7729f64589014cfc9c1cab6be247edd6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:39.891600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbefd87-def2-4523-92d8-d9d020c490f5 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:39.893273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 590/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:39 2022] GET /identity/v3/projects/7729f64589014cfc9c1cab6be247edd6 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:39.899088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:39.992096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27313230-18b9-44e6-a2c6-e943b9135d24 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:40.023913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f75df-db32-42a4-a947-0352fecbd69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:40.024767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f75df-db32-42a4-a947-0352fecbd69f None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:40.025047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f75df-db32-42a4-a947-0352fecbd69f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:40.025321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f75df-db32-42a4-a947-0352fecbd69f None admin] PATH_INFO: `/v3/projects/7729f64589014cfc9c1cab6be247edd6/users/2704372244f94691855019d7f075f684/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:40.027282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f75df-db32-42a4-a947-0352fecbd69f None admin] RBAC: Authorizing `identity:create_grant(project_id=7729f64589014cfc9c1cab6be247edd6, user_id=2704372244f94691855019d7f075f684, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:40.029256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f75df-db32-42a4-a947-0352fecbd69f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:40.108853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 602/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:52:39 2022] PUT /identity/v3/projects/7729f64589014cfc9c1cab6be247edd6/users/2704372244f94691855019d7f075f684/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:52:42.357994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a58aa-7188-41a2-bc02-1a4bd55729a9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:42.358530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a58aa-7188-41a2-bc02-1a4bd55729a9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:42.358638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a58aa-7188-41a2-bc02-1a4bd55729a9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:42.359969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 591/1193] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:52:42.365695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f3dc-7a41-47d2-9c35-9e1cddb29027 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:42.366105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f3dc-7a41-47d2-9c35-9e1cddb29027 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:42.366261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780f3dc-7a41-47d2-9c35-9e1cddb29027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:42.383169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1780f3dc-7a41-47d2-9c35-9e1cddb29027 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:52:42.384384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1780f3dc-7a41-47d2-9c35-9e1cddb29027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:52:42.447022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 603/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:52:42.470448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a58aa-7188-41a2-bc02-1a4bd55729a9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:42.581836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a58aa-7188-41a2-bc02-1a4bd55729a9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:42.613982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:42.614707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:42.614987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:42.615296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:42.625579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:52:42.632989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:52:42.634135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:52:42.640149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 592/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:52:42.640896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f3dc-7a41-47d2-9c35-9e1cddb29027 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:42.735975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780f3dc-7a41-47d2-9c35-9e1cddb29027 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:42.768482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:42.769150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:42.769432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:42.769706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:42.770450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:42.770755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:42.772138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:42.780743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 604/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:42.786528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:42.883833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7444e62d-e8f4-4217-abcc-d0a4578946d2 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:42.915962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:42.916819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:42.917096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:42.917369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] PATH_INFO: `/v3/users/2704372244f94691855019d7f075f684` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:42.918528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] RBAC: Authorizing `identity:get_user(user_id=2704372244f94691855019d7f075f684)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:42.920101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:42.921701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 593/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Tue May 10 20:52:42 2022] GET /identity/v3/users/2704372244f94691855019d7f075f684 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:42.927901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:43.021660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587f6a-d4c6-4765-935b-061640956980 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:43.053326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:43.053959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:43.054239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:43.054512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:43.116492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:43.117894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:43.208852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 605/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:52:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:52:43.214733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:43.308920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a862c2-a2af-43d8-a6a0-14c6149c6177 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:43.341266 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7706a3-6045-48f3-9ae1-2b7485e9c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:43.342101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7706a3-6045-48f3-9ae1-2b7485e9c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:43.342378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7706a3-6045-48f3-9ae1-2b7485e9c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:43.342652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7706a3-6045-48f3-9ae1-2b7485e9c8e0 None admin] PATH_INFO: `/v3/projects/7729f64589014cfc9c1cab6be247edd6` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:43.343782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7706a3-6045-48f3-9ae1-2b7485e9c8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=7729f64589014cfc9c1cab6be247edd6)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:43.345217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7706a3-6045-48f3-9ae1-2b7485e9c8e0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:43.346944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 594/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Tue May 10 20:52:43 2022] GET /identity/v3/projects/7729f64589014cfc9c1cab6be247edd6 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:52:43.352941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:52:43.445215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166bd2c-7d8a-4086-aeee-7173ba7a9f28 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:52:43.476847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d339921-496d-488e-bdd1-96a2a2102555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:52:43.477428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d339921-496d-488e-bdd1-96a2a2102555 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:52:43.477708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d339921-496d-488e-bdd1-96a2a2102555 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:52:43.477980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d339921-496d-488e-bdd1-96a2a2102555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:52:43.478803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d339921-496d-488e-bdd1-96a2a2102555 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=7729f64589014cfc9c1cab6be247edd6, user.id=2704372244f94691855019d7f075f684) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:52:43.479112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d339921-496d-488e-bdd1-96a2a2102555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:52:43.480547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d339921-496d-488e-bdd1-96a2a2102555 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:52:43.486813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 606/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:52:43 2022] GET /identity/v3/role_assignments?user.id=2704372244f94691855019d7f075f684&scope.project.id=7729f64589014cfc9c1cab6be247edd6&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:00.759745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f31ab-9eb5-465a-984b-937d8da70b1e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:00.760327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f31ab-9eb5-465a-984b-937d8da70b1e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:00.760327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1f31ab-9eb5-465a-984b-937d8da70b1e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:00.761785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 595/1201] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:00.767115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca376-5120-4866-aa1c-97d43d33eaf2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:00.767607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca376-5120-4866-aa1c-97d43d33eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:00.767759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ca376-5120-4866-aa1c-97d43d33eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:00.785258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-073ca376-5120-4866-aa1c-97d43d33eaf2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:00.786533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-073ca376-5120-4866-aa1c-97d43d33eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:00.850380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 607/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:00.875931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f31ab-9eb5-465a-984b-937d8da70b1e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:00.973277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1f31ab-9eb5-465a-984b-937d8da70b1e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:01.005646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:01.006429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:01.006769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:01.007044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:01.016840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:01.018335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:01.036148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:01.037328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:01.038761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:01.038761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:01.038761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:01.038761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:01.038761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 596/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:01.043387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ca376-5120-4866-aa1c-97d43d33eaf2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:01.139666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ca376-5120-4866-aa1c-97d43d33eaf2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:01.174338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e89d0-7c3c-40d9-bf13-78c0f347388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:01.174993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e89d0-7c3c-40d9-bf13-78c0f347388d None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:01.175307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e89d0-7c3c-40d9-bf13-78c0f347388d None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:01.175667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e89d0-7c3c-40d9-bf13-78c0f347388d None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:01.176389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e89d0-7c3c-40d9-bf13-78c0f347388d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:01.176689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e89d0-7c3c-40d9-bf13-78c0f347388d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:01.178054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e89d0-7c3c-40d9-bf13-78c0f347388d None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:01.188996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 608/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:01.194709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:01.292088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4fdbb-76b4-4b69-996f-15e245145dfc None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:01.324510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7400-8e90-4eb9-889b-040cf8ef316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:01.325167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7400-8e90-4eb9-889b-040cf8ef316e None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:01.325447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7400-8e90-4eb9-889b-040cf8ef316e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:01.325720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7400-8e90-4eb9-889b-040cf8ef316e None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:01.326413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7400-8e90-4eb9-889b-040cf8ef316e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:01.328967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7400-8e90-4eb9-889b-040cf8ef316e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:01.462379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 597/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Tue May 10 20:54:01 2022] POST /identity/v3/users => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:54:03.692111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4f48a-9931-44eb-b445-688ccd81a9a8 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:03.692666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4f48a-9931-44eb-b445-688ccd81a9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:03.692777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4f48a-9931-44eb-b445-688ccd81a9a8 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:03.694151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 609/1206] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:03.699465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156611d-2aa7-4029-bd4e-9798435ba246 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:03.699995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156611d-2aa7-4029-bd4e-9798435ba246 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:03.700175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156611d-2aa7-4029-bd4e-9798435ba246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:03.716451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a156611d-2aa7-4029-bd4e-9798435ba246 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:03.717703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a156611d-2aa7-4029-bd4e-9798435ba246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:03.782897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 598/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 10 20:54:03.806515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4f48a-9931-44eb-b445-688ccd81a9a8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:03.905793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4f48a-9931-44eb-b445-688ccd81a9a8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:03.938757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:03.939585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:03.939870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:03.940146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:03.950271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:54:03.958031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:03.958994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:03.959975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 610/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:54:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:03.965231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156611d-2aa7-4029-bd4e-9798435ba246 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:04.062110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156611d-2aa7-4029-bd4e-9798435ba246 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:04.095416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:04.096074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:04.096360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:04.096639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:04.097386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:04.097701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:04.099084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:04.106884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 599/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:04.113270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:04.209389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca83ded-48cd-4845-bb5d-45b72913a6e5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:04.242364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:04.243225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:04.243513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:04.243789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:04.253616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:04.255138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:04.272677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:04.278296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:04.279418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:04.279418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:04.279418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:04.279418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:04.279418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 611/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:04.280335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:04.374768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6d19d-278b-4f10-a2cb-0ce3873b52e9 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:04.407098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:04.407781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:04.408057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:04.408331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:04.409047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:04.409349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:04.410723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:04.422577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 600/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:54:04.428793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:04.525151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b94af-b0a7-40dc-b2a6-feb79e03b50f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:04.558060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:04.558885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:04.559273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:04.559562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:04.567405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:04.568839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:54:04.583843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:04.586324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:04.587335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 612/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:04.590987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:04.689296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fba55-dfb4-416d-a74b-e4e7ed8c9bd0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:04.722063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:04.722728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:04.723012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:04.723321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:04.724150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:04.724465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:04.725898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:04.742604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 601/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 20:54:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:04.749045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:04.847563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42af997-bebb-4d4a-ae18-c44225a009b7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:04.880205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:04.880857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:04.881144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:04.881419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:04.946419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:04.947882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:05.040963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 613/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:54:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:54:05.047497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:05.146893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5740b0d5-641a-47ab-b516-bbdbdef43fb1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:05.181272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:05.182106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:05.182388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:05.182666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:05.194110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:05.195617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:05.212827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:05.213947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:05.215257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:05.215257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:05.215257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:05.215257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:05.215257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 602/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:05.220113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:05.314843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5b6b21-8330-4b36-a01b-9f1bd2c55a92 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:05.347904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:05.348557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:05.348840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:05.349117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:05.349922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:05.350229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:05.351629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:05.363701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 614/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:05.369300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:05.465750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd4253-45c3-42c3-8903-a6a9ef7ea020 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:05.499488 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:05.500270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:05.500554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:05.500834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:05.507551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:05.508994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:54:05.522446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:05.523561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:05.524742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 603/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:05.530206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:05.628226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8734-7601-4eb5-bc9d-72530b148b9b None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:05.660109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bb9d2-5600-4f6a-be7b-68810ed6f2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:05.660762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb9d2-5600-4f6a-be7b-68810ed6f2ff None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:05.661043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb9d2-5600-4f6a-be7b-68810ed6f2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:05.661313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bb9d2-5600-4f6a-be7b-68810ed6f2ff None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:05.662095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bb9d2-5600-4f6a-be7b-68810ed6f2ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:05.662397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bb9d2-5600-4f6a-be7b-68810ed6f2ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:05.663832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013bb9d2-5600-4f6a-be7b-68810ed6f2ff None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:05.676353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 615/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:54:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:05.682346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:05.778756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14f4b2-63c0-435e-aad8-f71115622015 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:05.811898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6f894-f327-4309-8ff7-8d7533dded5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:05.812546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6f894-f327-4309-8ff7-8d7533dded5a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:05.812859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6f894-f327-4309-8ff7-8d7533dded5a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:05.813154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6f894-f327-4309-8ff7-8d7533dded5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:05.813955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6f894-f327-4309-8ff7-8d7533dded5a None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=e538db4da67443e286408deb9663a083) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:05.814273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6f894-f327-4309-8ff7-8d7533dded5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:05.815739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6f894-f327-4309-8ff7-8d7533dded5a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:05.821146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 604/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:54:05 2022] GET /identity/v3/role_assignments?user.id=e538db4da67443e286408deb9663a083&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:08.005789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fccd9-aec7-437f-846c-388db11b5ff3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:08.006295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fccd9-aec7-437f-846c-388db11b5ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:08.006295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fccd9-aec7-437f-846c-388db11b5ff3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:08.007681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 616/1220] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:08.013204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663421-9aae-4448-b7b0-7ed166216060 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:08.013660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663421-9aae-4448-b7b0-7ed166216060 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:08.013755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663421-9aae-4448-b7b0-7ed166216060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:08.031625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-57663421-9aae-4448-b7b0-7ed166216060 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:08.032784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-57663421-9aae-4448-b7b0-7ed166216060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:08.096614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 605/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:08.119204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fccd9-aec7-437f-846c-388db11b5ff3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:08.217824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fccd9-aec7-437f-846c-388db11b5ff3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:08.251248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:08.252047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:08.252333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:08.252613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:08.262699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:54:08.270409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:08.271554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:08.272613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 617/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:54:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:08.277707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57663421-9aae-4448-b7b0-7ed166216060 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:08.372850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57663421-9aae-4448-b7b0-7ed166216060 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:08.405512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:08.406160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:08.406442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:08.406717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:08.407488 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:08.407790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:08.409179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:08.416834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 606/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:54:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:08.423729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:08.519033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddab5d-2386-46d3-ab44-fd5c603aaff8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:08.553023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:08.553898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:08.554276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:08.554556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:08.565968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:08.567433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:08.584298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:08.585352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:08.586615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:08.586615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:08.586615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:08.586615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:08.586615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 618/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:08.591247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:08.695956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ac9a5-0c18-45df-b880-1e1f6c16a8c3 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:08.728651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:08.729306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:08.729591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:08.729871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:08.730589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:08.730898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:08.732358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:08.743968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 607/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:08.750069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:08.848272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf9bbc-f18a-426e-8fd0-a5fbb4517162 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:08.880391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:08.881175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:08.881452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:08.882029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:08.891094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:08.892609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:54:08.907531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:08.908778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:08.909762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 619/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:08.914720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:09.009698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f01c4c-3e13-4dc5-97b9-eeeb4bc262bf None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:09.042770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:09.043502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:09.043758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:09.044033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:09.044868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:09.045178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:09.046629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:09.064209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 608/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 20:54:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:09.070067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:09.166582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d2b56-1e9c-4c54-8024-961105c95bdf None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:09.199352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:09.200142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:09.200427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:09.200707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:09.211529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:09.212977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:09.229528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:09.230564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:09.231544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:09.231544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:09.231544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:09.231544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:09.231544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 620/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:09.236828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:09.335225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6606c-53c5-4781-bac3-a72cf7cdef0c None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:09.367851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:09.368500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:09.368780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:09.369054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:09.369823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:09.370127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:09.371525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:09.383316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 609/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:09.389203 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:09.485721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca915be-cc53-4926-bdd6-fbb6dd6b73d8 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:09.518127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:09.518910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:09.519226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:09.519506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:09.525984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:09.527463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:54:09.541798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:09.548369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:09.549438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 621/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:54:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:09.550065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:09.646831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980ff28-6c0a-4b3a-a213-e012c496874b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:09.679061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdfc14-e51e-4364-a568-933e31956358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:09.679729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdfc14-e51e-4364-a568-933e31956358 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:09.680006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdfc14-e51e-4364-a568-933e31956358 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:09.680277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdfc14-e51e-4364-a568-933e31956358 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:09.681047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdfc14-e51e-4364-a568-933e31956358 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:09.681391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdfc14-e51e-4364-a568-933e31956358 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:09.682800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdfc14-e51e-4364-a568-933e31956358 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:09.695027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 610/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:54:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:09.700963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:09.798972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c50e6-b186-4bab-b632-96c3160c636e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:09.830533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f5e3d-eabb-43d6-b83b-3f19299b99f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:09.831440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f5e3d-eabb-43d6-b83b-3f19299b99f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:09.831778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f5e3d-eabb-43d6-b83b-3f19299b99f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:09.836776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f5e3d-eabb-43d6-b83b-3f19299b99f4 None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/e538db4da67443e286408deb9663a083/roles/bd48cc77ef9847008cb25340f9c96405` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:09.846555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f5e3d-eabb-43d6-b83b-3f19299b99f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=e538db4da67443e286408deb9663a083, role_id=bd48cc77ef9847008cb25340f9c96405)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:09.848018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f5e3d-eabb-43d6-b83b-3f19299b99f4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:09.936247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 622/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:54:09 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/e538db4da67443e286408deb9663a083/roles/bd48cc77ef9847008cb25340f9c96405 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:54:12.149997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d3c2f-25c5-4215-a9e6-46faaa3f7fe7 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:12.150522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d3c2f-25c5-4215-a9e6-46faaa3f7fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:12.150640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d3c2f-25c5-4215-a9e6-46faaa3f7fe7 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:12.151965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 611/1233] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:12.157937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454c65-3140-4bf7-94f6-9ad9a6e3cd08 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:12.158422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454c65-3140-4bf7-94f6-9ad9a6e3cd08 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:12.158518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f454c65-3140-4bf7-94f6-9ad9a6e3cd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:12.175400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4f454c65-3140-4bf7-94f6-9ad9a6e3cd08 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:12.176594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4f454c65-3140-4bf7-94f6-9ad9a6e3cd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:12.241469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 623/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:12.264641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d3c2f-25c5-4215-a9e6-46faaa3f7fe7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:12.364160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d3c2f-25c5-4215-a9e6-46faaa3f7fe7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:12.396544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:12.397424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:12.397705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:12.397976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:12.408341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:54:12.415955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:12.421542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:12.422650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 612/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Tue May 10 20:54:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:12.423823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454c65-3140-4bf7-94f6-9ad9a6e3cd08 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:12.517356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f454c65-3140-4bf7-94f6-9ad9a6e3cd08 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:12.549649 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:12.550317 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:12.550600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:12.550872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:12.551652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] RBAC: Adding query filter params (name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:12.551956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:12.553332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:12.561964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 624/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Tue May 10 20:54:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:12.567612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:12.668788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1170acd-7b04-4a33-b4bc-5ce955227e20 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:12.701426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:12.702958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:12.703112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:12.703311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:12.713364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:12.714813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:12.731613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:12.732672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:12.734549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:12.734549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:12.734549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:12.734549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:12.734549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 613/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:12.738723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:12.835384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341222a-fa11-48aa-b52f-3e4bc0126604 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:12.867927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:12.868584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:12.868891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:12.869168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:12.869888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:12.870196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:12.871631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:12.882910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 625/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:12.888701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:12.986897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9fbb8-faf7-4893-abe1-8ad5a444d8b1 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:13.019608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:13.020391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:13.020672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:13.020945 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:13.028186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:13.029626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:54:13.043766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:13.051956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:13.053141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 614/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:13.053902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:13.148083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7739df-b234-4bb9-bad9-06e8634abdff None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:13.180128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:13.180806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:13.181080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:13.181350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:13.182189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:13.182492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:13.183927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:13.201235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 626/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 20:54:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:13.206924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:13.304118 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c6191-586f-4783-8482-bbad4c77db4b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:13.336524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101346-9480-4681-bde1-54bda842b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:13.337176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101346-9480-4681-bde1-54bda842b824 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:13.337461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101346-9480-4681-bde1-54bda842b824 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:13.337739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be101346-9480-4681-bde1-54bda842b824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:13.402914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101346-9480-4681-bde1-54bda842b824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:13.404401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be101346-9480-4681-bde1-54bda842b824 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:13.498801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 615/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:54:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:54:13.504694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:13.599791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e18e35-73e6-4456-b2e5-da7716a19fc4 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:13.634161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:13.635351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:13.635351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:13.635633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:13.645881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:13.647332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:13.665481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:13.666572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:13.667811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:13.667811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:13.667811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:13.667811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:13.667811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 627/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:13.672362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101346-9480-4681-bde1-54bda842b824 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:13.766911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be101346-9480-4681-bde1-54bda842b824 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:13.802803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:13.803493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:13.803777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:13.804052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:13.804765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:13.805069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:13.806443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:13.818238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 616/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:13.823937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:13.919308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c09f12f-620d-4b2b-bc99-a17fe511445f None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:13.951806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:13.952619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:13.952867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:13.953140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:13.959734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:13.961160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:54:13.974690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:13.975776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:13.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 628/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:54:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:13.981782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:14.080184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e0c82-0086-4172-aa33-f21b36802e2e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:14.112616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284fb62-f1e6-4065-ad89-97b0339b4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:14.113267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284fb62-f1e6-4065-ad89-97b0339b4766 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:14.113551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284fb62-f1e6-4065-ad89-97b0339b4766 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:14.113828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284fb62-f1e6-4065-ad89-97b0339b4766 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:14.114647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284fb62-f1e6-4065-ad89-97b0339b4766 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:14.114958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284fb62-f1e6-4065-ad89-97b0339b4766 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:14.116430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284fb62-f1e6-4065-ad89-97b0339b4766 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:14.128026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 617/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:54:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:14.134250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:14.233235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0dbf47-8e51-40ab-859d-88505d36c563 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:14.265217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f64aba-1ba1-40e7-b0b4-1d087d3e624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:14.265867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64aba-1ba1-40e7-b0b4-1d087d3e624e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:14.266151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64aba-1ba1-40e7-b0b4-1d087d3e624e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:14.266427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f64aba-1ba1-40e7-b0b4-1d087d3e624e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:14.267492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64aba-1ba1-40e7-b0b4-1d087d3e624e None admin] RBAC: Adding query filter params (role.id=bd48cc77ef9847008cb25340f9c96405, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=e538db4da67443e286408deb9663a083) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:14.267810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64aba-1ba1-40e7-b0b4-1d087d3e624e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:14.269235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f64aba-1ba1-40e7-b0b4-1d087d3e624e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:14.274956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 629/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:54:14 2022] GET /identity/v3/role_assignments?user.id=e538db4da67443e286408deb9663a083&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=bd48cc77ef9847008cb25340f9c96405 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:16.530775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4452168-4d88-417d-9027-3a4fbdd45433 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:16.531345 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4452168-4d88-417d-9027-3a4fbdd45433 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:16.531345 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4452168-4d88-417d-9027-3a4fbdd45433 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:16.533264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 618/1247] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:16.538476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4703-0443-49cc-be6c-50e6f9f2a051 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:16.538907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4703-0443-49cc-be6c-50e6f9f2a051 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:16.538999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b4703-0443-49cc-be6c-50e6f9f2a051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:16.556229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-060b4703-0443-49cc-be6c-50e6f9f2a051 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:16.557413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-060b4703-0443-49cc-be6c-50e6f9f2a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:16.622111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 630/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:16.645073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4452168-4d88-417d-9027-3a4fbdd45433 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:16.745078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4452168-4d88-417d-9027-3a4fbdd45433 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:16.788295 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:16.789011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:16.789343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:16.789611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:16.811265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:54:16.819272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:16.821064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:16.822716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 619/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:54:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:54:16.826668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4703-0443-49cc-be6c-50e6f9f2a051 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:16.922095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b4703-0443-49cc-be6c-50e6f9f2a051 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:16.955621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:16.956283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:16.956570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:16.956844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:16.957589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:16.957893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:16.959310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:16.966956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 631/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:54:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:16.973356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:17.070538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b8259-dfd9-48ca-8dac-f256e4ac5710 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:17.105486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:17.106277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:17.106561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:17.106835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:17.117927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:17.119420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:17.136940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:17.137962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:17.139515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:17.139515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:17.139515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:17.139515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:17.139515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 620/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:17.144491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:17.241826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf94a96-28ed-4095-8979-d3c8a59f3ea9 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:17.273459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:17.274119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:17.274406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:17.274686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:17.275461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:17.275772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:17.281064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:17.289000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 632/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:17.294731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:17.391382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fda6f2-4c04-4956-b3b2-8d63988ead5b None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:17.424779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:17.425594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:17.425858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:17.426133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:17.433637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:17.437917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:54:17.451921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:17.452928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:17.454186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 621/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:17.460957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:17.555719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5c6e1-9e30-413e-95f0-8a1f09d05d21 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:17.589272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:17.589937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:17.590222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:17.590492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:17.591354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:17.591660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:17.593124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:17.610585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 633/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 20:54:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:17.616717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:17.714467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13207775-62db-401e-aa1d-f11d0a1c8465 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:17.746933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:17.747605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:17.747886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:17.748168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:17.815999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:17.817447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:17.911278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 622/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:54:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:54:17.917010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:18.013308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144d508-a591-4391-9c70-d1ab5e705772 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:18.045688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:18.046498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:18.046784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:18.047059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:18.057536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:18.058984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:18.075904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:18.076872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:18.077877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:18.077877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:18.077877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:18.077877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:18.077877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 634/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:18.083464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:18.182023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243af064-d151-441e-9df7-efa337c77d8e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:18.214773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:18.215448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:18.215727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:18.216000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:18.216710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:18.217013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:18.218383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:18.229954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 623/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:18.235608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:18.332382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c0e5f-0e91-4b1d-bf40-da83f4f61176 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:18.365219 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:18.366003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:18.366288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:18.366564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:18.373047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:18.374515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:54:18.388080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:18.389182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:18.390231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 635/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:18.395951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:18.494186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30705527-f8a7-473b-b8b1-2c66a0b5670a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:18.526609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece4cd3-342b-4a07-9a31-9859887c9c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:18.527277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece4cd3-342b-4a07-9a31-9859887c9c66 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:18.527555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece4cd3-342b-4a07-9a31-9859887c9c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:18.527864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece4cd3-342b-4a07-9a31-9859887c9c66 None admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:18.536907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece4cd3-342b-4a07-9a31-9859887c9c66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:18.536907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece4cd3-342b-4a07-9a31-9859887c9c66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:18.536907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece4cd3-342b-4a07-9a31-9859887c9c66 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:18.542052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 624/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:18.548065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:18.646874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c944e-2f25-4fcc-aae6-21aa9512d487 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:18.679735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a44bc-5600-4412-bfbe-0643915ea8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:18.680387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a44bc-5600-4412-bfbe-0643915ea8ac None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:18.680674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a44bc-5600-4412-bfbe-0643915ea8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:18.680954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a44bc-5600-4412-bfbe-0643915ea8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:18.681815 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a44bc-5600-4412-bfbe-0643915ea8ac None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=e538db4da67443e286408deb9663a083) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:18.682126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a44bc-5600-4412-bfbe-0643915ea8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:18.683576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a44bc-5600-4412-bfbe-0643915ea8ac None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:18.688923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 636/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:54:18 2022] GET /identity/v3/role_assignments?user.id=e538db4da67443e286408deb9663a083&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:20.869056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee9e8-b699-42a0-b326-d04af99b7898 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:20.869628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee9e8-b699-42a0-b326-d04af99b7898 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:20.869628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ee9e8-b699-42a0-b326-d04af99b7898 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:20.870923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 625/1261] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:20.876332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9d0c9-d996-4877-810c-01b22af588d3 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:20.877448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9d0c9-d996-4877-810c-01b22af588d3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:20.877544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9d0c9-d996-4877-810c-01b22af588d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:20.893800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-00e9d0c9-d996-4877-810c-01b22af588d3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:20.894963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-00e9d0c9-d996-4877-810c-01b22af588d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:20.959544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 637/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:20.982246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ee9e8-b699-42a0-b326-d04af99b7898 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:21.083165 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ee9e8-b699-42a0-b326-d04af99b7898 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:21.117344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:21.118119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:21.118404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:21.118679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:21.128978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:54:21.136420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:21.137566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:21.138577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 626/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:21.145768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9d0c9-d996-4877-810c-01b22af588d3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:21.239489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9d0c9-d996-4877-810c-01b22af588d3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:21.271668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:21.272337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:21.272620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:21.272896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:21.273641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:21.273969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:21.275357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:21.285053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 638/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:21.290943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:21.390536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a342d-f807-4931-9c4a-23a49a6e7595 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:21.424361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:21.425143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:21.425420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:21.425729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:21.435979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:21.437475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:21.453722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:21.455520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:21.456697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:21.456697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:21.456697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:21.456697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:21.456697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 627/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:21.461210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:21.556863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753169f6-4ad3-4d49-8165-98c854e98cff None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:21.591861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:21.592514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:21.592794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:21.593067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:21.593787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:21.594090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:21.596029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:21.607818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 639/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:21.613915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:21.712632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804631b-e58b-4a18-ac10-7d9461dcf9d4 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:21.744899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:21.745689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:21.745976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:21.746256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:21.754183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:21.755660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:54:21.769913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:21.771020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:21.772042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 628/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:21.776886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:21.876255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d523131-fe7d-45b2-9412-d66f67dc0040 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:21.910010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:21.910727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:21.911001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:21.911310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:21.912248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:21.912560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:21.913981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:21.930971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 640/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 20:54:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:21.936596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:22.033632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629038da-a7f3-48ae-acfd-75a81c50b91d None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:22.066707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:22.067620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:22.067902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:22.068174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:22.078260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:22.079823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:22.096748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:22.097885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:22.098812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:22.098812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:22.098812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:22.098812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:22.098812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 629/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:22.103610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:22.211399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5726e-71ae-4d6e-9add-02d793854a19 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:22.244470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:22.245125 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:22.245405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:22.245675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:22.246385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:22.246686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:22.248065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:22.259080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 641/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:22.264896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:22.360958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b88876-bd6b-49a4-b3cb-40e0ccecf6d0 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:22.394867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:22.395697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:22.395975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:22.396252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:22.402942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:22.404448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:54:22.418355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:22.419318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:22.420288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 630/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:54:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:22.425629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:22.523892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fca33-0964-48a5-bdc4-33398acbef59 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:22.557108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda095c-9bd8-44e4-a66d-8f35e7f9853f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:22.557762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda095c-9bd8-44e4-a66d-8f35e7f9853f None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:22.558046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda095c-9bd8-44e4-a66d-8f35e7f9853f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:22.558446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda095c-9bd8-44e4-a66d-8f35e7f9853f None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:22.559267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda095c-9bd8-44e4-a66d-8f35e7f9853f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:22.559578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda095c-9bd8-44e4-a66d-8f35e7f9853f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:22.561006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda095c-9bd8-44e4-a66d-8f35e7f9853f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:22.574431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 642/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:54:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:22.580610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:22.680631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8c15b-c028-4269-b1a7-8ba86f6ef713 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:22.713993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41f339-bb35-49b3-9d5f-caf67b679a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:22.714865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41f339-bb35-49b3-9d5f-caf67b679a1d None admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:22.715164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41f339-bb35-49b3-9d5f-caf67b679a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:22.715442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41f339-bb35-49b3-9d5f-caf67b679a1d None admin] PATH_INFO: `/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/e538db4da67443e286408deb9663a083/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:22.717363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41f339-bb35-49b3-9d5f-caf67b679a1d None admin] RBAC: Authorizing `identity:create_grant(project_id=711fa023a8be4b6fbf9cf36a185d4971, user_id=e538db4da67443e286408deb9663a083, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:22.718785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41f339-bb35-49b3-9d5f-caf67b679a1d None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:22.804904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 631/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Tue May 10 20:54:22 2022] PUT /identity/v3/projects/711fa023a8be4b6fbf9cf36a185d4971/users/e538db4da67443e286408deb9663a083/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 20:54:25.015867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7eb93-fba6-4116-9906-446e7520dc39 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:25.016465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7eb93-fba6-4116-9906-446e7520dc39 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:25.016465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7eb93-fba6-4116-9906-446e7520dc39 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:25.018462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 643/1274] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:25.023668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e92285-9c63-4135-a039-cd9c60a45304 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:25.024119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e92285-9c63-4135-a039-cd9c60a45304 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:25.024221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e92285-9c63-4135-a039-cd9c60a45304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:25.041356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-61e92285-9c63-4135-a039-cd9c60a45304 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:25.042533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-61e92285-9c63-4135-a039-cd9c60a45304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:25.106676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 632/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:25.130228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7eb93-fba6-4116-9906-446e7520dc39 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:25.229405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7eb93-fba6-4116-9906-446e7520dc39 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:25.261593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:25.262402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:25.262681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:25.262954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:25.272899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(role_id) May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 10 20:54:25.280355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:25.281614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:25.283081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 644/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Tue May 10 20:54:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:25.288159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e92285-9c63-4135-a039-cd9c60a45304 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:25.385256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e92285-9c63-4135-a039-cd9c60a45304 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:25.418984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:25.419672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:25.419982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:25.420256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:25.420995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:25.421300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:25.422689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:25.431565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 633/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Tue May 10 20:54:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:25.437451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:25.534399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495d395-4163-4d83-bb95-1f3bb878dd75 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:25.567081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:25.567937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:25.568321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:25.568593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:25.578717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:25.581069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:25.598088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:25.599275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:25.600226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:25.600226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:25.600226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:25.600226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:25.600226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 645/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:25.605210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:25.702484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d854bc-af5e-43b4-abe8-4307bfc3e657 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:25.735282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:25.736593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:25.736871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:25.737148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:25.737870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:25.738177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:25.739644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:25.752253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 634/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:25.757930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:25.853475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13cd43-ec65-4f42-99a2-73ae21a70082 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:25.886377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:25.887199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:25.887484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:25.887760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:25.895554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:25.896985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_user(user_id) May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 10 20:54:25.911591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:25.912621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:25.913674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 646/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 10 20:54:25.918678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:26.014139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7472cdf-0a95-4d67-8141-32dc8b19ba9a None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:26.047369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:26.048073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:26.048953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:26.049232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:26.050061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:26.050370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:26.051827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:26.068720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 635/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Tue May 10 20:54:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:26.074499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:26.170318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83199b62-942f-43bc-ae20-a240675ba52e None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:26.202938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:26.203604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:26.203882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:26.204154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:26.270403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:26.271885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:26.366549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 647/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Tue May 10 20:54:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 10 20:54:26.372344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:26.470843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578760cc-2c5d-4401-9f76-06fb8b173995 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:26.504763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:26.505547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:26.505843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:26.506100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:26.515726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:26.519423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 10 20:54:26.535106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:26.536103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:26.537110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 10 20:54:26.537110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 10 20:54:26.537110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 10 20:54:26.537110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:26.537110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 636/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 20:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:26.541933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:26.638162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de400d-4c42-4603-a85b-a0290075879a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:26.671091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:26.672718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:26.673023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:26.673590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:26.674362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:26.674677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:26.676182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:26.688055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 648/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Tue May 10 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 20:54:26.694120 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:26.790530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d3f27-293a-4d5a-bdf8-1a0a2e7da252 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:26.824392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:26.825172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:26.825452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:26.825726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:26.832451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:26.833987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(project_id) May 10 20:54:26.849342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application with Lock( May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:26.851016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: ERROR keystone.server.flask.application May 10 20:54:26.852847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 637/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Tue May 10 20:54:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:26.858715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:26.961891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6835fd-7ada-4e0b-b1a9-a6a7a5c0a5c5 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:26.996908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d7c0f-afed-4f4d-b7f8-ea41e6dd26c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:26.997724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7c0f-afed-4f4d-b7f8-ea41e6dd26c8 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:26.998065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7c0f-afed-4f4d-b7f8-ea41e6dd26c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:26.998408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7c0f-afed-4f4d-b7f8-ea41e6dd26c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:26.999313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d7c0f-afed-4f4d-b7f8-ea41e6dd26c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:26.999710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d7c0f-afed-4f4d-b7f8-ea41e6dd26c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:27.001501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d7c0f-afed-4f4d-b7f8-ea41e6dd26c8 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:27.015648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 649/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Tue May 10 20:54:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:27.022485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:27.125668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb83c77-8032-4511-abf4-8c90afb8f023 None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:27.162138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45b1b0-b1bf-4ac5-81f3-9378898305d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:27.162807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b1b0-b1bf-4ac5-81f3-9378898305d8 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:27.163092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b1b0-b1bf-4ac5-81f3-9378898305d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:27.163397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45b1b0-b1bf-4ac5-81f3-9378898305d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:27.164244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45b1b0-b1bf-4ac5-81f3-9378898305d8 None admin] RBAC: Adding query filter params (role.id=b16b59e995b44fdd9abdc47cf100f2c1, scope.project.id=711fa023a8be4b6fbf9cf36a185d4971, user.id=e538db4da67443e286408deb9663a083) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:27.164560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45b1b0-b1bf-4ac5-81f3-9378898305d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:27.166037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b45b1b0-b1bf-4ac5-81f3-9378898305d8 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:27.172801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 638/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Tue May 10 20:54:27 2022] GET /identity/v3/role_assignments?user.id=e538db4da67443e286408deb9663a083&scope.project.id=711fa023a8be4b6fbf9cf36a185d4971&role.id=b16b59e995b44fdd9abdc47cf100f2c1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:29.435095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fdf4c-1bae-468e-b943-6e9e5f773a46 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:29.435678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fdf4c-1bae-468e-b943-6e9e5f773a46 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:29.435678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96fdf4c-1bae-468e-b943-6e9e5f773a46 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:29.437018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 650/1288] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:29.442181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc473e8-44bb-40ca-b0f7-423163165d1b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:29.442775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc473e8-44bb-40ca-b0f7-423163165d1b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:29.442775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc473e8-44bb-40ca-b0f7-423163165d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:29.459721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ccc473e8-44bb-40ca-b0f7-423163165d1b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:29.460887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ccc473e8-44bb-40ca-b0f7-423163165d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:29.525671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 639/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:29.548616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fdf4c-1bae-468e-b943-6e9e5f773a46 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:29.647620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96fdf4c-1bae-468e-b943-6e9e5f773a46 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:29.679453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:29.680239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:29.680515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:29.680790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:29.681435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:29.682856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:29.696357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:29.697597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:29.698545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 651/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:54:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:29.702342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc473e8-44bb-40ca-b0f7-423163165d1b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:29.801421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc473e8-44bb-40ca-b0f7-423163165d1b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:29.834630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207e545-0ce4-4c15-b8ef-ecafd056246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:29.835343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207e545-0ce4-4c15-b8ef-ecafd056246f None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:29.835628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207e545-0ce4-4c15-b8ef-ecafd056246f None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:29.835905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207e545-0ce4-4c15-b8ef-ecafd056246f None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:29.836607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207e545-0ce4-4c15-b8ef-ecafd056246f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:29.836915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207e545-0ce4-4c15-b8ef-ecafd056246f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:29.838285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207e545-0ce4-4c15-b8ef-ecafd056246f None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:29.843082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 640/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 20:54:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:29.849831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:29.949694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c95a-4096-4c89-a5e7-2c4b3246c8e7 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:29.982627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854bc86-ed99-4257-adca-47ea42a0dab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:29.983309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bc86-ed99-4257-adca-47ea42a0dab5 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:29.983657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bc86-ed99-4257-adca-47ea42a0dab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:29.983934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854bc86-ed99-4257-adca-47ea42a0dab5 None admin] PATH_INFO: `/v3/services` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:29.984670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854bc86-ed99-4257-adca-47ea42a0dab5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:29.984975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854bc86-ed99-4257-adca-47ea42a0dab5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:29.987038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854bc86-ed99-4257-adca-47ea42a0dab5 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:29.991467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 652/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 20:54:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:32.202925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49601a6-50ff-441a-a09d-8db72948576e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:32.203523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49601a6-50ff-441a-a09d-8db72948576e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:32.203523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49601a6-50ff-441a-a09d-8db72948576e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:32.205059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 641/1293] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:32.210208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271ee12-52ff-472e-b5b4-d33efc2d339b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:32.210629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271ee12-52ff-472e-b5b4-d33efc2d339b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:32.213772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271ee12-52ff-472e-b5b4-d33efc2d339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:32.227964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0271ee12-52ff-472e-b5b4-d33efc2d339b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:32.229159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0271ee12-52ff-472e-b5b4-d33efc2d339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:32.294177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 653/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:32.317259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49601a6-50ff-441a-a09d-8db72948576e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:32.416192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49601a6-50ff-441a-a09d-8db72948576e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:32.450082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5528ea-b2fd-48b4-b0dc-c4b5ffdd3089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:32.450730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5528ea-b2fd-48b4-b0dc-c4b5ffdd3089 None admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:32.451008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5528ea-b2fd-48b4-b0dc-c4b5ffdd3089 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:32.451310 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5528ea-b2fd-48b4-b0dc-c4b5ffdd3089 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:32.452021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5528ea-b2fd-48b4-b0dc-c4b5ffdd3089 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:32.453440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5528ea-b2fd-48b4-b0dc-c4b5ffdd3089 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:32.523261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 642/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Tue May 10 20:54:32 2022] POST /identity/v3/services => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 20:54:34.733209 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb7932-0f2a-4d08-a8b2-4f02e6f48757 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:34.733734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb7932-0f2a-4d08-a8b2-4f02e6f48757 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:34.733734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb7932-0f2a-4d08-a8b2-4f02e6f48757 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:34.735107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 654/1296] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 20:54:34.740809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4daf94-58f7-4c54-a569-98034af5e368 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:34.741219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4daf94-58f7-4c54-a569-98034af5e368 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:34.741356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4daf94-58f7-4c54-a569-98034af5e368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:34.758242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cd4daf94-58f7-4c54-a569-98034af5e368 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:34.759471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd4daf94-58f7-4c54-a569-98034af5e368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:34.830159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 643/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:34.853031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb7932-0f2a-4d08-a8b2-4f02e6f48757 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:34.952154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb7932-0f2a-4d08-a8b2-4f02e6f48757 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:34.984808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:34.986357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:34.986714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:34.986988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:34.987669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:34.989031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:35.000498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:35.001949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:35.003186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 655/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:54:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:35.008345 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4daf94-58f7-4c54-a569-98034af5e368 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:35.103520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4daf94-58f7-4c54-a569-98034af5e368 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:35.136010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:35.136665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:35.136943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:35.137214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:35.137911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:35.138214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:35.139633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:35.144657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 644/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 20:54:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:35.150591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:35.246861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcce957-5117-4e46-b2ee-78b46e9262d2 None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:35.278403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581d78-16d9-4f2f-ae5e-e1f60a8234fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:35.279473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581d78-16d9-4f2f-ae5e-e1f60a8234fa None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:35.279473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581d78-16d9-4f2f-ae5e-e1f60a8234fa None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:35.279719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581d78-16d9-4f2f-ae5e-e1f60a8234fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:35.280372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581d78-16d9-4f2f-ae5e-e1f60a8234fa None admin] RBAC: Adding query filter params (interface=public, service_id=76d7d7a0de4b47c494062f2931d82122, region_id=RegionOne) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:35.280679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581d78-16d9-4f2f-ae5e-e1f60a8234fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:35.282027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581d78-16d9-4f2f-ae5e-e1f60a8234fa None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:35.287460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 656/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Tue May 10 20:54:35 2022] GET /identity/v3/endpoints?service_id=76d7d7a0de4b47c494062f2931d82122&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:35.293071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:35.386422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a5d4e-f8ab-4b38-be1a-c88fc308e89e None admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:35.419467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe1ad7-f5f5-48ff-9210-897c289b3b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:35.420119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1ad7-f5f5-48ff-9210-897c289b3b75 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:35.420400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1ad7-f5f5-48ff-9210-897c289b3b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:35.420673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1ad7-f5f5-48ff-9210-897c289b3b75 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:35.421343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe1ad7-f5f5-48ff-9210-897c289b3b75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:35.422701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe1ad7-f5f5-48ff-9210-897c289b3b75 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:35.429643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 645/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Tue May 10 20:54:35 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 20:54:37.611914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b688db-e3d3-4d17-935c-540c15a18932 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:37.612453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b688db-e3d3-4d17-935c-540c15a18932 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:37.612555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b688db-e3d3-4d17-935c-540c15a18932 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:37.613865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 657/1302] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 20:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 20:54:37.619206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566ca98-aa7c-4ce5-a037-86d4bbc73a63 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:37.619606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566ca98-aa7c-4ce5-a037-86d4bbc73a63 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:37.619766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566ca98-aa7c-4ce5-a037-86d4bbc73a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:37.636474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e566ca98-aa7c-4ce5-a037-86d4bbc73a63 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 20:54:37.637682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e566ca98-aa7c-4ce5-a037-86d4bbc73a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 20:54:37.701897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 646/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 20:54:37 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 10 20:54:37.724268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b688db-e3d3-4d17-935c-540c15a18932 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:37.822858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b688db-e3d3-4d17-935c-540c15a18932 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:37.857101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:37.857101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:37.857101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:37.857101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:37.857492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:37.858162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 20:54:37.870667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_service(service_id) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 20:54:37.871951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 20:54:37.873019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 658/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Tue May 10 20:54:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 10 20:54:37.878978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566ca98-aa7c-4ce5-a037-86d4bbc73a63 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:37.975576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566ca98-aa7c-4ce5-a037-86d4bbc73a63 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:38.008309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e2359-88e2-470c-9fb1-3eb21b6b2764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:38.008960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2359-88e2-470c-9fb1-3eb21b6b2764 None admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:38.009241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2359-88e2-470c-9fb1-3eb21b6b2764 None admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:38.009512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e2359-88e2-470c-9fb1-3eb21b6b2764 None admin] PATH_INFO: `/v3/services` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:38.010204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2359-88e2-470c-9fb1-3eb21b6b2764 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 20:54:38.010509 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2359-88e2-470c-9fb1-3eb21b6b2764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:38.011891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e2359-88e2-470c-9fb1-3eb21b6b2764 None admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:38.017035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 647/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Tue May 10 20:54:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 20:54:38.022841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 20:54:38.121528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c76a69-09b1-4dd2-9e38-d2f7129f288a None admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 20:54:38.156107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4401-8f66-4cbd-9342-8a8e6f56ad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 20:54:38.156785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4401-8f66-4cbd-9342-8a8e6f56ad6f None admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 20:54:38.157039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4401-8f66-4cbd-9342-8a8e6f56ad6f None admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 20:54:38.158235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4401-8f66-4cbd-9342-8a8e6f56ad6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 20:54:38.158986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4401-8f66-4cbd-9342-8a8e6f56ad6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 20:54:38.160382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4401-8f66-4cbd-9342-8a8e6f56ad6f None admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 20:54:38.238650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 659/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Tue May 10 20:54:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:00:25.323978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fca3f-df0a-4207-8f01-ab639f5bb3df None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:25.324970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fca3f-df0a-4207-8f01-ab639f5bb3df None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:25.325450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fca3f-df0a-4207-8f01-ab639f5bb3df None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:25.333262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f781b-cebe-463e-8b51-cb9d501e60d2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:25.334276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f781b-cebe-463e-8b51-cb9d501e60d2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:25.334758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f781b-cebe-463e-8b51-cb9d501e60d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:25.336930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 648/1307] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:25 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:25.422199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-9f1f781b-cebe-463e-8b51-cb9d501e60d2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:25.424067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9f1f781b-cebe-463e-8b51-cb9d501e60d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:25.559749 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 660/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:00:25.594448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf55e31-13da-41e2-8b67-c4ebe3692181 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:25.594786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf55e31-13da-41e2-8b67-c4ebe3692181 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:25.595654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf55e31-13da-41e2-8b67-c4ebe3692181 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:25.597294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 649/1309] 10.222.0.49 () {54 vars in 964 bytes} [Tue May 10 21:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:25.605547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af209784-6cf2-4953-91d0-a5cc912abd60 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:25.610669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af209784-6cf2-4953-91d0-a5cc912abd60 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:25.611483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af209784-6cf2-4953-91d0-a5cc912abd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:25.694502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-af209784-6cf2-4953-91d0-a5cc912abd60 None None] MFA Rules not processed for user `c298cfd105174cd89ba5ef6eb50b1601`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:25.696225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-af209784-6cf2-4953-91d0-a5cc912abd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:25.794066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 661/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Tue May 10 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:25.808101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf55e31-13da-41e2-8b67-c4ebe3692181 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:25.810290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ecf55e31-13da-41e2-8b67-c4ebe3692181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:25.943290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf55e31-13da-41e2-8b67-c4ebe3692181 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:26.019630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f1e260-3a3a-474e-923f-8e543299179b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:26.020312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e260-3a3a-474e-923f-8e543299179b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:26.020556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e260-3a3a-474e-923f-8e543299179b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:26.020829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f1e260-3a3a-474e-923f-8e543299179b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:26.022538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-74f1e260-3a3a-474e-923f-8e543299179b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:26.152270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1e260-3a3a-474e-923f-8e543299179b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:26.153963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f1e260-3a3a-474e-923f-8e543299179b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:26.173760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 650/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:28.752384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02a6ad-3aac-4842-a7d3-463294298d6e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:28.752963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02a6ad-3aac-4842-a7d3-463294298d6e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:28.752963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02a6ad-3aac-4842-a7d3-463294298d6e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:28.758681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 662/1312] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:28.760346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1578a8-45c6-4049-8ebe-b165941369f0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:28.760883 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1578a8-45c6-4049-8ebe-b165941369f0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:28.761103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1578a8-45c6-4049-8ebe-b165941369f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:28.875174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8e1578a8-45c6-4049-8ebe-b165941369f0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:28.877453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e1578a8-45c6-4049-8ebe-b165941369f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:28.990394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 651/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:00:29.028571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02a6ad-3aac-4842-a7d3-463294298d6e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:29.030129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bb02a6ad-3aac-4842-a7d3-463294298d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:29.135248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02a6ad-3aac-4842-a7d3-463294298d6e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:29.213280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237123-cb3f-4477-8e8c-fe73223fb17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:29.213885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237123-cb3f-4477-8e8c-fe73223fb17a service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:29.214173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237123-cb3f-4477-8e8c-fe73223fb17a service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:29.214451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237123-cb3f-4477-8e8c-fe73223fb17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:29.216210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ac237123-cb3f-4477-8e8c-fe73223fb17a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:29.324048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac237123-cb3f-4477-8e8c-fe73223fb17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:29.325485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac237123-cb3f-4477-8e8c-fe73223fb17a service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:29.344156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 663/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:32.148113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbebd8c-3b6f-4f72-8959-3d92a876d42b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:32.148670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbebd8c-3b6f-4f72-8959-3d92a876d42b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:32.148670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbebd8c-3b6f-4f72-8959-3d92a876d42b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:32.150027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 652/1315] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:32.155133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefa1a-c3f0-4dd2-8698-312f02317fdf None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:32.155560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefa1a-c3f0-4dd2-8698-312f02317fdf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:32.155698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefa1a-c3f0-4dd2-8698-312f02317fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:32.219133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d2aefa1a-c3f0-4dd2-8698-312f02317fdf None None] MFA Rules not processed for user `0c09c92ec34a444caeb82c56a979d386`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:32.220871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d2aefa1a-c3f0-4dd2-8698-312f02317fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:32.313674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 664/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:32.353028 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbebd8c-3b6f-4f72-8959-3d92a876d42b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:32.354572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9cbebd8c-3b6f-4f72-8959-3d92a876d42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:32.454750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbebd8c-3b6f-4f72-8959-3d92a876d42b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:32.526357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd68022-0893-4f0f-99c1-8257d937d50a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:32.526997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68022-0893-4f0f-99c1-8257d937d50a service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:32.527309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68022-0893-4f0f-99c1-8257d937d50a service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:32.527586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd68022-0893-4f0f-99c1-8257d937d50a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:32.529219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-edd68022-0893-4f0f-99c1-8257d937d50a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:32.635143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd68022-0893-4f0f-99c1-8257d937d50a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:32.636853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd68022-0893-4f0f-99c1-8257d937d50a service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:32.654716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 653/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:36.167626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bff81f-5042-467a-b047-26190e5c69d4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:36.168230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bff81f-5042-467a-b047-26190e5c69d4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:36.168230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bff81f-5042-467a-b047-26190e5c69d4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:36.169564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 665/1318] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:36.175978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086108d0-f72e-49a3-9510-1c7a22ac20bf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:36.176423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086108d0-f72e-49a3-9510-1c7a22ac20bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:36.176525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086108d0-f72e-49a3-9510-1c7a22ac20bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:36.243284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-086108d0-f72e-49a3-9510-1c7a22ac20bf None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:36.244492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-086108d0-f72e-49a3-9510-1c7a22ac20bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:36.338820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 654/1319] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:36.379191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bff81f-5042-467a-b047-26190e5c69d4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:36.380127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-66bff81f-5042-467a-b047-26190e5c69d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:36.481895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bff81f-5042-467a-b047-26190e5c69d4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:36.552527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998de68-0125-42ac-b4ae-846a77f5688b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:36.553732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998de68-0125-42ac-b4ae-846a77f5688b service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:36.554012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998de68-0125-42ac-b4ae-846a77f5688b service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:36.554285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998de68-0125-42ac-b4ae-846a77f5688b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:36.555975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d998de68-0125-42ac-b4ae-846a77f5688b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:36.662269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998de68-0125-42ac-b4ae-846a77f5688b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:36.663744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998de68-0125-42ac-b4ae-846a77f5688b service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:36.681863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 666/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:39.943441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149605d-4260-4323-9c1b-a50fe47e6690 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:39.944012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149605d-4260-4323-9c1b-a50fe47e6690 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:39.944012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149605d-4260-4323-9c1b-a50fe47e6690 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:39.945371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 655/1321] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:39.950577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4b66d-f4ab-45a5-b513-c41c28d6852d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:39.950986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4b66d-f4ab-45a5-b513-c41c28d6852d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:39.951171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4b66d-f4ab-45a5-b513-c41c28d6852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.014981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4ed4b66d-f4ab-45a5-b513-c41c28d6852d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:40.016222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4ed4b66d-f4ab-45a5-b513-c41c28d6852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:40.109486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 667/1322] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:40.161867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7bcd-35c5-4752-b0ca-2ed48626df50 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:40.171348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7bcd-35c5-4752-b0ca-2ed48626df50 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:40.171348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c7bcd-35c5-4752-b0ca-2ed48626df50 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.171348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 656/1323] 10.222.0.49 () {54 vars in 964 bytes} [Tue May 10 21:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:40.171627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296025-324e-487c-9f24-db01924fe766 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:40.171627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296025-324e-487c-9f24-db01924fe766 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:40.171627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62296025-324e-487c-9f24-db01924fe766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.245146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-62296025-324e-487c-9f24-db01924fe766 None None] MFA Rules not processed for user `c298cfd105174cd89ba5ef6eb50b1601`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:40.246273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-62296025-324e-487c-9f24-db01924fe766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:40.321991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 668/1324] 10.222.0.49 () {58 vars in 1061 bytes} [Tue May 10 21:00:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:00:40.331451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c7bcd-35c5-4752-b0ca-2ed48626df50 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:40.332972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e28c7bcd-35c5-4752-b0ca-2ed48626df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:40.435268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c7bcd-35c5-4752-b0ca-2ed48626df50 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:40.509271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b24718-a087-41d8-a033-bca1beffb373 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:40.509840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24718-a087-41d8-a033-bca1beffb373 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:40.510112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24718-a087-41d8-a033-bca1beffb373 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:40.510384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b24718-a087-41d8-a033-bca1beffb373 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:40.512162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c6b24718-a087-41d8-a033-bca1beffb373 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:40.622848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24718-a087-41d8-a033-bca1beffb373 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:40.624360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b24718-a087-41d8-a033-bca1beffb373 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:40.642233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 657/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:43.233540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ea309-7363-4007-a832-b178e7ac3f74 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:43.234118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ea309-7363-4007-a832-b178e7ac3f74 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:43.234118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01ea309-7363-4007-a832-b178e7ac3f74 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:43.236103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 669/1326] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:43.241291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beabcbc-7bdb-4edd-869c-bded357a8538 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:43.241726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beabcbc-7bdb-4edd-869c-bded357a8538 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:43.241919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beabcbc-7bdb-4edd-869c-bded357a8538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:43.305906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7beabcbc-7bdb-4edd-869c-bded357a8538 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:43.307112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7beabcbc-7bdb-4edd-869c-bded357a8538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:43.401116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 658/1327] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:43.437646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ea309-7363-4007-a832-b178e7ac3f74 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:43.439416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f01ea309-7363-4007-a832-b178e7ac3f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:43.542737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01ea309-7363-4007-a832-b178e7ac3f74 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:43.616392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875a94b-9adc-4c46-be0c-e48af8d26fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:43.617059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a94b-9adc-4c46-be0c-e48af8d26fee service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:43.617344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a94b-9adc-4c46-be0c-e48af8d26fee service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:43.617622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875a94b-9adc-4c46-be0c-e48af8d26fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:43.619327 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5875a94b-9adc-4c46-be0c-e48af8d26fee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:43.728358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875a94b-9adc-4c46-be0c-e48af8d26fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:43.729794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875a94b-9adc-4c46-be0c-e48af8d26fee service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:43.747023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 670/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:46.038577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa68c-135c-497c-9fbf-6228216d26b9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.039162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa68c-135c-497c-9fbf-6228216d26b9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.039162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fa68c-135c-497c-9fbf-6228216d26b9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.040522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 659/1329] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:46.045826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1f833-8a35-414d-a4fe-121d2e106b64 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.046266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1f833-8a35-414d-a4fe-121d2e106b64 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.046525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1f833-8a35-414d-a4fe-121d2e106b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.109977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-08b1f833-8a35-414d-a4fe-121d2e106b64 None None] MFA Rules not processed for user `0c09c92ec34a444caeb82c56a979d386`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:46.111893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-08b1f833-8a35-414d-a4fe-121d2e106b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:46.204487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 671/1330] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:46.241773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fa68c-135c-497c-9fbf-6228216d26b9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:46.243391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-624fa68c-135c-497c-9fbf-6228216d26b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:46.344416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fa68c-135c-497c-9fbf-6228216d26b9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:46.414888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269b98a-4119-44e5-90b1-5c3456b608b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:46.415561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b98a-4119-44e5-90b1-5c3456b608b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:46.415844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b98a-4119-44e5-90b1-5c3456b608b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:46.416119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269b98a-4119-44e5-90b1-5c3456b608b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:46.417774 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7269b98a-4119-44e5-90b1-5c3456b608b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:46.525428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b98a-4119-44e5-90b1-5c3456b608b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:46.526874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269b98a-4119-44e5-90b1-5c3456b608b3 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:46.546003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 660/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:49.409831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b176d-a4ba-4c60-91f3-d811c266454a None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.410284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b176d-a4ba-4c60-91f3-d811c266454a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.412852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b176d-a4ba-4c60-91f3-d811c266454a None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.412852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 672/1332] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:49.417375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127f04-29a2-4b34-a8b9-866c3cad8d1c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.417798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127f04-29a2-4b34-a8b9-866c3cad8d1c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.418083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127f04-29a2-4b34-a8b9-866c3cad8d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.482478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5a127f04-29a2-4b34-a8b9-866c3cad8d1c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:49.483635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5a127f04-29a2-4b34-a8b9-866c3cad8d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:49.584315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 661/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:00:49.620073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b176d-a4ba-4c60-91f3-d811c266454a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:49.621607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3c9b176d-a4ba-4c60-91f3-d811c266454a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:49.725167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b176d-a4ba-4c60-91f3-d811c266454a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:49.797473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8b3ff-c8cd-4a65-9807-28cce3915107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:49.798146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8b3ff-c8cd-4a65-9807-28cce3915107 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:49.798442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8b3ff-c8cd-4a65-9807-28cce3915107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:49.798712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8b3ff-c8cd-4a65-9807-28cce3915107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:49.800786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6cb8b3ff-c8cd-4a65-9807-28cce3915107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:49.911385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8b3ff-c8cd-4a65-9807-28cce3915107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:49.912881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8b3ff-c8cd-4a65-9807-28cce3915107 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:49.932076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 673/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:52.186215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8120391-a21d-447f-bdf8-bb30d37489b6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:52.186762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8120391-a21d-447f-bdf8-bb30d37489b6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:52.186762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8120391-a21d-447f-bdf8-bb30d37489b6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:52.188687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 662/1335] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:52.194182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475128-efd8-41e9-8ed8-231d41f361e1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:52.194633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475128-efd8-41e9-8ed8-231d41f361e1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:52.194730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f475128-efd8-41e9-8ed8-231d41f361e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:52.256628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2f475128-efd8-41e9-8ed8-231d41f361e1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:52.257816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2f475128-efd8-41e9-8ed8-231d41f361e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:52.350409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 674/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:52.389762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8120391-a21d-447f-bdf8-bb30d37489b6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:52.391402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d8120391-a21d-447f-bdf8-bb30d37489b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:52.493565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8120391-a21d-447f-bdf8-bb30d37489b6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:52.565234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e900d63-f47f-474a-8eeb-dffc760441ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:52.565873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e900d63-f47f-474a-8eeb-dffc760441ae service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:52.566157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e900d63-f47f-474a-8eeb-dffc760441ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:52.566428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e900d63-f47f-474a-8eeb-dffc760441ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:52.568103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e900d63-f47f-474a-8eeb-dffc760441ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:52.675321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e900d63-f47f-474a-8eeb-dffc760441ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:52.676762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e900d63-f47f-474a-8eeb-dffc760441ae service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:52.695056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 663/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:00:55.461454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4e39d-bb7c-4fd3-8eed-e768a552286c None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:55.462051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4e39d-bb7c-4fd3-8eed-e768a552286c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:55.462051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4e39d-bb7c-4fd3-8eed-e768a552286c None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:55.463399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 675/1338] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:00:55.468489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959920-2f2a-4942-83b8-6e12f3dffaf4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:55.468922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959920-2f2a-4942-83b8-6e12f3dffaf4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:55.469051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d959920-2f2a-4942-83b8-6e12f3dffaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:55.534017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7d959920-2f2a-4942-83b8-6e12f3dffaf4 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:00:55.535220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7d959920-2f2a-4942-83b8-6e12f3dffaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:55.628194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 664/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:00:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:00:55.662588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4e39d-bb7c-4fd3-8eed-e768a552286c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:00:55.665944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4ae4e39d-bb7c-4fd3-8eed-e768a552286c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:55.771921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4e39d-bb7c-4fd3-8eed-e768a552286c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:00:55.775425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9d6339-6fff-4823-ae94-5c7599b0a7d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:00:55.776062 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d6339-6fff-4823-ae94-5c7599b0a7d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:00:55.776344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d6339-6fff-4823-ae94-5c7599b0a7d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:00:55.776617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9d6339-6fff-4823-ae94-5c7599b0a7d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:00:55.778340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5d9d6339-6fff-4823-ae94-5c7599b0a7d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:00:55.874844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d6339-6fff-4823-ae94-5c7599b0a7d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:00:55.876360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9d6339-6fff-4823-ae94-5c7599b0a7d4 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:00:55.894210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 676/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:00:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:00.513255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edba0-cb15-4255-9e42-69026c1fd17e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.513789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edba0-cb15-4255-9e42-69026c1fd17e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.513789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1edba0-cb15-4255-9e42-69026c1fd17e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.515200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 665/1341] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:00.521205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41fed-4f34-45dd-a562-c3e2e7b3d3cb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.521637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41fed-4f34-45dd-a562-c3e2e7b3d3cb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.521817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b41fed-4f34-45dd-a562-c3e2e7b3d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.572118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-46b41fed-4f34-45dd-a562-c3e2e7b3d3cb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:00.573251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-46b41fed-4f34-45dd-a562-c3e2e7b3d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:00.657322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 677/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:00.695428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1edba0-cb15-4255-9e42-69026c1fd17e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:00.697585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ef1edba0-cb15-4255-9e42-69026c1fd17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:00.711545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1edba0-cb15-4255-9e42-69026c1fd17e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:00.714988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3f756-f9c5-4b89-929d-afbb0adaca9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:00.715654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f756-f9c5-4b89-929d-afbb0adaca9e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:00.715933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f756-f9c5-4b89-929d-afbb0adaca9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:00.716205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3f756-f9c5-4b89-929d-afbb0adaca9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:00.725036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f756-f9c5-4b89-929d-afbb0adaca9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:00.726452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3f756-f9c5-4b89-929d-afbb0adaca9e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:00.736440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 666/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:04.200790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b715-b009-409e-845d-8306ef6485dc None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:04.201360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b715-b009-409e-845d-8306ef6485dc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:04.201360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874b715-b009-409e-845d-8306ef6485dc None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:04.203152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 678/1344] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:04.210722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914200e9-4265-46c5-96af-856cb0a98d69 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:04.210722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914200e9-4265-46c5-96af-856cb0a98d69 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:04.210722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914200e9-4265-46c5-96af-856cb0a98d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:04.240467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-914200e9-4265-46c5-96af-856cb0a98d69 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:04.241662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-914200e9-4265-46c5-96af-856cb0a98d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:04.250058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 667/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:04.289224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b715-b009-409e-845d-8306ef6485dc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:04.301011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874b715-b009-409e-845d-8306ef6485dc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:04.304727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28e6f3-3594-4044-8a14-302391d1f870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:04.305353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e6f3-3594-4044-8a14-302391d1f870 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:04.305659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e6f3-3594-4044-8a14-302391d1f870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:04.306405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28e6f3-3594-4044-8a14-302391d1f870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:04.315613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28e6f3-3594-4044-8a14-302391d1f870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:04.317024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28e6f3-3594-4044-8a14-302391d1f870 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:04.326227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 679/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:08.994906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16116-8a83-4a11-b616-ce419c5792f4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:08.995470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16116-8a83-4a11-b616-ce419c5792f4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:08.995470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b16116-8a83-4a11-b616-ce419c5792f4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:08.996753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 668/1347] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:09.002087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e48a8-6444-41ca-9d78-a2d1317737e8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:09.002491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e48a8-6444-41ca-9d78-a2d1317737e8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:09.002644 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e48a8-6444-41ca-9d78-a2d1317737e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:09.021103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-399e48a8-6444-41ca-9d78-a2d1317737e8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:09.022282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-399e48a8-6444-41ca-9d78-a2d1317737e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:09.030298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 680/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:09.067968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b16116-8a83-4a11-b616-ce419c5792f4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:09.079053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b16116-8a83-4a11-b616-ce419c5792f4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:09.082626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e71007-30ca-4b27-8025-2cff9d1e8fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:09.083283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71007-30ca-4b27-8025-2cff9d1e8fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:09.083564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71007-30ca-4b27-8025-2cff9d1e8fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:09.083838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e71007-30ca-4b27-8025-2cff9d1e8fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:09.092646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e71007-30ca-4b27-8025-2cff9d1e8fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:09.094099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e71007-30ca-4b27-8025-2cff9d1e8fb3 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:09.104823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 669/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:14.400891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed43114-181b-4d7a-9aec-8abc758067de None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.401826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed43114-181b-4d7a-9aec-8abc758067de None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.402321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed43114-181b-4d7a-9aec-8abc758067de None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.407753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 681/1350] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:01:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:14.417025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27c57-45c3-4814-b2ab-a3fc035cf6ee None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:14.417926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27c57-45c3-4814-b2ab-a3fc035cf6ee None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:14.418409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f27c57-45c3-4814-b2ab-a3fc035cf6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:14.507539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d6f27c57-45c3-4814-b2ab-a3fc035cf6ee None None] MFA Rules not processed for user `e538db4da67443e286408deb9663a083`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:14.508979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d6f27c57-45c3-4814-b2ab-a3fc035cf6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:14.584613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 670/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:01:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:19.151596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47a30c-96e7-4e7e-9f3d-f9de74ad90e3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.152133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47a30c-96e7-4e7e-9f3d-f9de74ad90e3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.152133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de47a30c-96e7-4e7e-9f3d-f9de74ad90e3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.153726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 682/1352] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:01:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:19.159407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55686c3-c013-43a1-a575-6bca52300c38 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:19.159849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55686c3-c013-43a1-a575-6bca52300c38 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:19.160263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55686c3-c013-43a1-a575-6bca52300c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:19.179922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c55686c3-c013-43a1-a575-6bca52300c38 None None] MFA Rules not processed for user `e538db4da67443e286408deb9663a083`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:19.181267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c55686c3-c013-43a1-a575-6bca52300c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:19.190319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 671/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:01:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:20.445779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b14782-2a0a-432b-8a18-3fd46d078314 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.446328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b14782-2a0a-432b-8a18-3fd46d078314 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.446419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b14782-2a0a-432b-8a18-3fd46d078314 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.447980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 683/1354] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:20.453083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893b02e-7ee5-494d-9f37-655a1804e595 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:20.454061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893b02e-7ee5-494d-9f37-655a1804e595 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:20.454235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893b02e-7ee5-494d-9f37-655a1804e595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:20.473008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9893b02e-7ee5-494d-9f37-655a1804e595 None None] MFA Rules not processed for user `e538db4da67443e286408deb9663a083`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:20.474195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9893b02e-7ee5-494d-9f37-655a1804e595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:20.482734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 672/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:01:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:24.384085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f788d-cc4a-41ca-a5d2-cfc9575e8488 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.384646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f788d-cc4a-41ca-a5d2-cfc9575e8488 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.384646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f788d-cc4a-41ca-a5d2-cfc9575e8488 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.386147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 684/1356] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:24.391374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d7ec-6347-4585-a73c-6a895d5f5691 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.391769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d7ec-6347-4585-a73c-6a895d5f5691 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.391942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d7ec-6347-4585-a73c-6a895d5f5691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.410004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cd80d7ec-6347-4585-a73c-6a895d5f5691 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:24.415398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd80d7ec-6347-4585-a73c-6a895d5f5691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:24.419230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 673/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:01:24.467558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38302cb-ab10-4593-9dd4-169d2b1977a8 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.467861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38302cb-ab10-4593-9dd4-169d2b1977a8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.468141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38302cb-ab10-4593-9dd4-169d2b1977a8 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.470183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 685/1358] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 21:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:24.475370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c96f-fd9e-45b0-8768-08b8b7a6264a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.475766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c96f-fd9e-45b0-8768-08b8b7a6264a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.476193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93c96f-fd9e-45b0-8768-08b8b7a6264a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.524734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0a93c96f-fd9e-45b0-8768-08b8b7a6264a None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:24.526074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a93c96f-fd9e-45b0-8768-08b8b7a6264a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:24.610411 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 674/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 21:01:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:24.618439 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38302cb-ab10-4593-9dd4-169d2b1977a8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:24.633571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38302cb-ab10-4593-9dd4-169d2b1977a8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:24.639494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009b514-1e09-4e11-981f-8bfcad7d3024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:24.640278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009b514-1e09-4e11-981f-8bfcad7d3024 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:24.640796 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009b514-1e09-4e11-981f-8bfcad7d3024 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:24.641272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009b514-1e09-4e11-981f-8bfcad7d3024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:24.649669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009b514-1e09-4e11-981f-8bfcad7d3024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:24.651578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009b514-1e09-4e11-981f-8bfcad7d3024 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:24.663156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 686/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:27.122830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdd3f-2dcd-473b-a278-0e094db7c94d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.123400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdd3f-2dcd-473b-a278-0e094db7c94d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.123400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffdd3f-2dcd-473b-a278-0e094db7c94d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.124768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 675/1361] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:27.130853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c97a-351a-4a58-9014-b7d654872ab8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.131324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c97a-351a-4a58-9014-b7d654872ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.131452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186c97a-351a-4a58-9014-b7d654872ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.149190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a186c97a-351a-4a58-9014-b7d654872ab8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:27.150396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a186c97a-351a-4a58-9014-b7d654872ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:27.158492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 687/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:27.202970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdd3f-2dcd-473b-a278-0e094db7c94d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:27.217497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffdd3f-2dcd-473b-a278-0e094db7c94d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:27.223236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602450-df80-4d74-a120-ec4975bf2e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:27.223876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602450-df80-4d74-a120-ec4975bf2e45 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:27.224340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602450-df80-4d74-a120-ec4975bf2e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:27.224623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602450-df80-4d74-a120-ec4975bf2e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:27.235570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602450-df80-4d74-a120-ec4975bf2e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:27.237423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602450-df80-4d74-a120-ec4975bf2e45 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:27.253974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 676/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:29.946001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffdf0f-5daf-4a5e-945d-8ce6ed4095be None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:29.946510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffdf0f-5daf-4a5e-945d-8ce6ed4095be None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:29.946608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ffdf0f-5daf-4a5e-945d-8ce6ed4095be None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:29.948153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 688/1364] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:29.957268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b5a3-bf78-41fc-9074-b95cb1ef8ab0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:29.957759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b5a3-bf78-41fc-9074-b95cb1ef8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:29.957974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0b5a3-bf78-41fc-9074-b95cb1ef8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:29.983511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f7c0b5a3-bf78-41fc-9074-b95cb1ef8ab0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:29.984427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f7c0b5a3-bf78-41fc-9074-b95cb1ef8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:29.995033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 677/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:30.039883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07deb8b-2848-4be4-9d24-afac0f0e24d2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.040381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07deb8b-2848-4be4-9d24-afac0f0e24d2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.040817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07deb8b-2848-4be4-9d24-afac0f0e24d2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.042372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 689/1366] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 21:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:30.048542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceabde-ad55-414e-a0eb-e95d12b7b990 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.048834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceabde-ad55-414e-a0eb-e95d12b7b990 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.049115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eceabde-ad55-414e-a0eb-e95d12b7b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.068551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7eceabde-ad55-414e-a0eb-e95d12b7b990 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:30.069748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7eceabde-ad55-414e-a0eb-e95d12b7b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:30.086883 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 678/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 21:01:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:30.087633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07deb8b-2848-4be4-9d24-afac0f0e24d2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:30.102026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07deb8b-2848-4be4-9d24-afac0f0e24d2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:30.108502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71f058-0a51-4e1c-b97e-674ff63ff99c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:30.110112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f058-0a51-4e1c-b97e-674ff63ff99c service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:30.110620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f058-0a51-4e1c-b97e-674ff63ff99c service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:30.111047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f058-0a51-4e1c-b97e-674ff63ff99c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:30.123021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71f058-0a51-4e1c-b97e-674ff63ff99c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:30.124733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee71f058-0a51-4e1c-b97e-674ff63ff99c service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:30.134431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 690/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:32.598510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40df6d2-d983-4d61-8823-5854c015b966 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.599636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40df6d2-d983-4d61-8823-5854c015b966 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.600136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40df6d2-d983-4d61-8823-5854c015b966 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.602054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 679/1369] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:32.608115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cafa1-a464-43fb-838e-85ee3b64a387 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.608976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cafa1-a464-43fb-838e-85ee3b64a387 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.609919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4cafa1-a464-43fb-838e-85ee3b64a387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.630051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7d4cafa1-a464-43fb-838e-85ee3b64a387 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:32.631688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7d4cafa1-a464-43fb-838e-85ee3b64a387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:32.640703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 691/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:32.684441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40df6d2-d983-4d61-8823-5854c015b966 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:32.699209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40df6d2-d983-4d61-8823-5854c015b966 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:32.704911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cfae7-f6c2-4ca7-b27c-7877849b8d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:32.705645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cfae7-f6c2-4ca7-b27c-7877849b8d95 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.705929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cfae7-f6c2-4ca7-b27c-7877849b8d95 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.706208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cfae7-f6c2-4ca7-b27c-7877849b8d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.707252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2e1d-b4b1-4f25-9c4d-3f9d04f5b1c9 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.707556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2e1d-b4b1-4f25-9c4d-3f9d04f5b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.707842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b2e1d-b4b1-4f25-9c4d-3f9d04f5b1c9 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.709254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 692/1371] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:32.714486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff567-5a10-4cff-abce-bd3c15db962e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:32.714776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff567-5a10-4cff-abce-bd3c15db962e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:32.715061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8ff567-5a10-4cff-abce-bd3c15db962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:32.718459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cfae7-f6c2-4ca7-b27c-7877849b8d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:32.721394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cfae7-f6c2-4ca7-b27c-7877849b8d95 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:32.731854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 680/1372] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:32.744265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ea8ff567-5a10-4cff-abce-bd3c15db962e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:32.745486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ea8ff567-5a10-4cff-abce-bd3c15db962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:32.753282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 693/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:01:33.079272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6e68-f6b6-48e9-b08a-8ccc59bedaaa None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.079702 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6e68-f6b6-48e9-b08a-8ccc59bedaaa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.080219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b6e68-f6b6-48e9-b08a-8ccc59bedaaa None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.081772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 681/1374] 10.222.0.49 () {54 vars in 963 bytes} [Tue May 10 21:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:33.087589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452bf85-ffa0-4b70-a740-4dfa925f5d28 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.087884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452bf85-ffa0-4b70-a740-4dfa925f5d28 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.088362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8452bf85-ffa0-4b70-a740-4dfa925f5d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.143263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8452bf85-ffa0-4b70-a740-4dfa925f5d28 None None] MFA Rules not processed for user `8f2ddd09bc4743f585cda702c3047e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:33.144470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8452bf85-ffa0-4b70-a740-4dfa925f5d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:33.205409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 694/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Tue May 10 21:01:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:33.212788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6e68-f6b6-48e9-b08a-8ccc59bedaaa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:33.224393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b6e68-f6b6-48e9-b08a-8ccc59bedaaa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:33.228235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c09d-7b02-40a8-8549-6231d5a8fc4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:33.228981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c09d-7b02-40a8-8549-6231d5a8fc4b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:33.229346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c09d-7b02-40a8-8549-6231d5a8fc4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:33.229691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c09d-7b02-40a8-8549-6231d5a8fc4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:33.239641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c09d-7b02-40a8-8549-6231d5a8fc4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:33.241152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c09d-7b02-40a8-8549-6231d5a8fc4b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:33.250968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 682/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:35.124726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab15e9-d247-4015-a162-89b071797221 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:35.125459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab15e9-d247-4015-a162-89b071797221 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:35.125459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cab15e9-d247-4015-a162-89b071797221 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:35.126933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 695/1377] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:35.133211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e010-819c-404c-b660-044e72ba7555 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:35.134313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e010-819c-404c-b660-044e72ba7555 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:35.134657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e010-819c-404c-b660-044e72ba7555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:35.154881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2f39e010-819c-404c-b660-044e72ba7555 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:35.157002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2f39e010-819c-404c-b660-044e72ba7555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:35.165811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 683/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:01:35.210681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab15e9-d247-4015-a162-89b071797221 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:35.225877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cab15e9-d247-4015-a162-89b071797221 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:35.231323 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65c298-2b96-42fd-950b-361b44545833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:35.231963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65c298-2b96-42fd-950b-361b44545833 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:35.232242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65c298-2b96-42fd-950b-361b44545833 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:35.232538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65c298-2b96-42fd-950b-361b44545833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:35.241671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65c298-2b96-42fd-950b-361b44545833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:35.243294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65c298-2b96-42fd-950b-361b44545833 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:35.253055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 696/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:37.641177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce8cc-8388-456c-9be3-a819e06c2abc None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.641759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce8cc-8388-456c-9be3-a819e06c2abc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.641759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce8cc-8388-456c-9be3-a819e06c2abc None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.643090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 684/1380] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:37.648689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68042c8-73b4-4e0a-a86c-63ff2df1aa04 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.649138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68042c8-73b4-4e0a-a86c-63ff2df1aa04 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.649257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68042c8-73b4-4e0a-a86c-63ff2df1aa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.670244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c68042c8-73b4-4e0a-a86c-63ff2df1aa04 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:37.671480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c68042c8-73b4-4e0a-a86c-63ff2df1aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:37.679874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 697/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:37.725653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce8cc-8388-456c-9be3-a819e06c2abc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:37.740389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce8cc-8388-456c-9be3-a819e06c2abc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:37.745991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f7bfb-9b80-43a9-a32f-1bfa4af06cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:37.746628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7bfb-9b80-43a9-a32f-1bfa4af06cf2 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:37.746914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7bfb-9b80-43a9-a32f-1bfa4af06cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:37.747227 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f7bfb-9b80-43a9-a32f-1bfa4af06cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:37.755527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f7bfb-9b80-43a9-a32f-1bfa4af06cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:37.757110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391f7bfb-9b80-43a9-a32f-1bfa4af06cf2 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:37.766989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 685/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:40.225421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd82bd9-cb91-48dc-af20-ebebb6c88cfa None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.226008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd82bd9-cb91-48dc-af20-ebebb6c88cfa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.226008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd82bd9-cb91-48dc-af20-ebebb6c88cfa None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.227385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 698/1383] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:40.232993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7ac23-0519-4627-b5bb-796251643453 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.233414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7ac23-0519-4627-b5bb-796251643453 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.233549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7ac23-0519-4627-b5bb-796251643453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.253332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ffa7ac23-0519-4627-b5bb-796251643453 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:40.254548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ffa7ac23-0519-4627-b5bb-796251643453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:40.263043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 686/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:40.306797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd82bd9-cb91-48dc-af20-ebebb6c88cfa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:40.323679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd82bd9-cb91-48dc-af20-ebebb6c88cfa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:40.332624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aa6ba-cec6-4a6c-9173-421392dd4c54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:40.332624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aa6ba-cec6-4a6c-9173-421392dd4c54 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:40.332624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aa6ba-cec6-4a6c-9173-421392dd4c54 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:40.332624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aa6ba-cec6-4a6c-9173-421392dd4c54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:40.340764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aa6ba-cec6-4a6c-9173-421392dd4c54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:40.342404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798aa6ba-cec6-4a6c-9173-421392dd4c54 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:40.352397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 699/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:01:42.755441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dc91f-8dc7-41e4-bc33-f04453263e3e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.755976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dc91f-8dc7-41e4-bc33-f04453263e3e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.756192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dc91f-8dc7-41e4-bc33-f04453263e3e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.758104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 687/1386] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:42.763680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c67fe-131b-440c-a0af-a101bd9a75a1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.764098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c67fe-131b-440c-a0af-a101bd9a75a1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.764367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c67fe-131b-440c-a0af-a101bd9a75a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.785171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-308c67fe-131b-440c-a0af-a101bd9a75a1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:42.786545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-308c67fe-131b-440c-a0af-a101bd9a75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:42.795514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 700/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:42.854491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dc91f-8dc7-41e4-bc33-f04453263e3e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:42.872457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dc91f-8dc7-41e4-bc33-f04453263e3e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:42.879599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccc5fc-ecbd-4cf0-9671-c2117314e749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:42.880476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc5fc-ecbd-4cf0-9671-c2117314e749 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:42.880849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc5fc-ecbd-4cf0-9671-c2117314e749 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:42.881207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc5fc-ecbd-4cf0-9671-c2117314e749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:42.893142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccc5fc-ecbd-4cf0-9671-c2117314e749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:42.894735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccc5fc-ecbd-4cf0-9671-c2117314e749 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:42.904358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 688/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:45.539664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef63c1-9bba-4eab-bf0b-9da99dd20265 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.540337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef63c1-9bba-4eab-bf0b-9da99dd20265 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.540337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef63c1-9bba-4eab-bf0b-9da99dd20265 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.541767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 701/1389] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:45.548519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97717b3-db7b-48cc-bf3d-5b69d031a7c8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.549070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97717b3-db7b-48cc-bf3d-5b69d031a7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.549198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97717b3-db7b-48cc-bf3d-5b69d031a7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.569399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b97717b3-db7b-48cc-bf3d-5b69d031a7c8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:45.570788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b97717b3-db7b-48cc-bf3d-5b69d031a7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:45.580020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 689/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:45.626400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef63c1-9bba-4eab-bf0b-9da99dd20265 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:45.640517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef63c1-9bba-4eab-bf0b-9da99dd20265 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:45.645951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd8ff54-7806-4d22-a72a-edf62d79c1eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:45.646592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ff54-7806-4d22-a72a-edf62d79c1eb service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:45.646872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ff54-7806-4d22-a72a-edf62d79c1eb service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:45.647177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd8ff54-7806-4d22-a72a-edf62d79c1eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:45.655541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8ff54-7806-4d22-a72a-edf62d79c1eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:45.657676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd8ff54-7806-4d22-a72a-edf62d79c1eb service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:45.667458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 702/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:48.044438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6a99-bab6-4d25-b883-ac9c86ccec79 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.045052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6a99-bab6-4d25-b883-ac9c86ccec79 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.045052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f6a99-bab6-4d25-b883-ac9c86ccec79 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.046346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 690/1392] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:48.051670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbde7-7c0b-4f89-80a9-7326983a028d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.052163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbde7-7c0b-4f89-80a9-7326983a028d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.052267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbde7-7c0b-4f89-80a9-7326983a028d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.069667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3f7cbde7-7c0b-4f89-80a9-7326983a028d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:48.070946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3f7cbde7-7c0b-4f89-80a9-7326983a028d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:48.079320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 703/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:48.123436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f6a99-bab6-4d25-b883-ac9c86ccec79 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:48.137547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f6a99-bab6-4d25-b883-ac9c86ccec79 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:48.143409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559157f4-4777-461f-8cdb-3d569ef0e0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:48.144039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559157f4-4777-461f-8cdb-3d569ef0e0d1 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:48.144319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559157f4-4777-461f-8cdb-3d569ef0e0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:48.144594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559157f4-4777-461f-8cdb-3d569ef0e0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:48.152701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559157f4-4777-461f-8cdb-3d569ef0e0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:48.154276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559157f4-4777-461f-8cdb-3d569ef0e0d1 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:48.164239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 691/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:49.245914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c333d9-92aa-4354-a9f8-4af15d3274dc None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.246480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c333d9-92aa-4354-a9f8-4af15d3274dc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.246480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c333d9-92aa-4354-a9f8-4af15d3274dc None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.247872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 704/1395] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:49.254070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e6be-ea95-4074-9121-abc9062e7441 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.254487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e6be-ea95-4074-9121-abc9062e7441 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.254703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904e6be-ea95-4074-9121-abc9062e7441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.272881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a904e6be-ea95-4074-9121-abc9062e7441 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:49.274074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a904e6be-ea95-4074-9121-abc9062e7441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:49.282011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 692/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:49.337468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59ca3-ea09-47aa-a903-0ccfbe62332b None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.337756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59ca3-ea09-47aa-a903-0ccfbe62332b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.338033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe59ca3-ea09-47aa-a903-0ccfbe62332b None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.339430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 705/1397] 10.222.0.49 () {54 vars in 962 bytes} [Tue May 10 21:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:49.344758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7dc98-f669-4821-81db-a0661cdc514f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.345045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7dc98-f669-4821-81db-a0661cdc514f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.345325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7dc98-f669-4821-81db-a0661cdc514f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.394044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e3f7dc98-f669-4821-81db-a0661cdc514f None None] MFA Rules not processed for user `69f37dda98124a8c8cf4406d985933f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:49.395261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e3f7dc98-f669-4821-81db-a0661cdc514f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:49.455573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 693/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Tue May 10 21:01:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:49.462923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59ca3-ea09-47aa-a903-0ccfbe62332b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:49.473548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe59ca3-ea09-47aa-a903-0ccfbe62332b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:49.477000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e727620-da2a-4313-9a49-631043efaa65 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f37dda98124a8c8cf4406d985933f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:49.477626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e727620-da2a-4313-9a49-631043efaa65 service glance] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:49.477903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e727620-da2a-4313-9a49-631043efaa65 service glance] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:49.478174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e727620-da2a-4313-9a49-631043efaa65 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:49.487417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e727620-da2a-4313-9a49-631043efaa65 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:49.488821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e727620-da2a-4313-9a49-631043efaa65 service glance] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:49.497999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 706/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:01:50.064546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639b65-7cd0-41e3-9158-865681b30073 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:50.064841 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639b65-7cd0-41e3-9158-865681b30073 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:50.065122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11639b65-7cd0-41e3-9158-865681b30073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:50.113600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-11639b65-7cd0-41e3-9158-865681b30073 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:50.114815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11639b65-7cd0-41e3-9158-865681b30073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:50.181939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 694/1400] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:01:50.226769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946785-dd58-449c-aebc-20e83a3bfad4 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:50.227538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946785-dd58-449c-aebc-20e83a3bfad4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:50.227824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d946785-dd58-449c-aebc-20e83a3bfad4 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:50.229276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 707/1401] 10.222.0.49 () {54 vars in 942 bytes} [Tue May 10 21:01:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:50.236565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9548-18ab-4245-ac99-99d5cba9962a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:50.240249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9548-18ab-4245-ac99-99d5cba9962a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:50.240249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc9548-18ab-4245-ac99-99d5cba9962a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:50.286297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9ffc9548-18ab-4245-ac99-99d5cba9962a None None] MFA Rules not processed for user `3616916c10eb4518bef958ead7176455`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:50.287592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9ffc9548-18ab-4245-ac99-99d5cba9962a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:50.363208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 695/1402] 10.222.0.49 () {58 vars in 1039 bytes} [Tue May 10 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:01:50.373712 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d946785-dd58-449c-aebc-20e83a3bfad4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:50.388975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d946785-dd58-449c-aebc-20e83a3bfad4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:50.395328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb4753d-8b8a-4299-886b-70c53a728222 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:50.396210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4753d-8b8a-4299-886b-70c53a728222 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:50.396424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4753d-8b8a-4299-886b-70c53a728222 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:50.396704 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb4753d-8b8a-4299-886b-70c53a728222 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:50.407246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4753d-8b8a-4299-886b-70c53a728222 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:50.408912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb4753d-8b8a-4299-886b-70c53a728222 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:50.417921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 708/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:01:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:01:50.555658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3216fb-fb1c-49a8-92e6-64466b736d44 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:50.555944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3216fb-fb1c-49a8-92e6-64466b736d44 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:50.556225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3216fb-fb1c-49a8-92e6-64466b736d44 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:50.557602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 696/1404] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:01:50.563881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9efe-8f23-46f8-a150-52c22a27d4b5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:50.564173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9efe-8f23-46f8-a150-52c22a27d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:50.564454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a9efe-8f23-46f8-a150-52c22a27d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:50.583436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b74a9efe-8f23-46f8-a150-52c22a27d4b5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:50.584573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b74a9efe-8f23-46f8-a150-52c22a27d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:50.592507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 709/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:50.639872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3216fb-fb1c-49a8-92e6-64466b736d44 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:50.654144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3216fb-fb1c-49a8-92e6-64466b736d44 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:50.660464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70c41f3-745d-48ad-acd4-25aba23644f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:50.661103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c41f3-745d-48ad-acd4-25aba23644f5 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:50.661388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c41f3-745d-48ad-acd4-25aba23644f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:50.661667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70c41f3-745d-48ad-acd4-25aba23644f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:50.669953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c41f3-745d-48ad-acd4-25aba23644f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:50.672313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70c41f3-745d-48ad-acd4-25aba23644f5 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:50.682345 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 697/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:01:53.083524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e9a8-3090-498b-9d1c-73ec99d0ac85 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.084117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e9a8-3090-498b-9d1c-73ec99d0ac85 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.084303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586e9a8-3090-498b-9d1c-73ec99d0ac85 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.086320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 710/1407] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:01:53.091332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545d78-6483-4800-8e31-297fefeb837d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.091765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545d78-6483-4800-8e31-297fefeb837d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.091908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96545d78-6483-4800-8e31-297fefeb837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.111792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-96545d78-6483-4800-8e31-297fefeb837d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:01:53.113062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96545d78-6483-4800-8e31-297fefeb837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:01:53.121743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 698/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:01:53.166786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586e9a8-3090-498b-9d1c-73ec99d0ac85 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:01:53.182263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586e9a8-3090-498b-9d1c-73ec99d0ac85 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:01:53.192767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c17843-25c0-4c8b-8fbb-8d8cdd35220c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:01:53.193429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c17843-25c0-4c8b-8fbb-8d8cdd35220c service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:01:53.193711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c17843-25c0-4c8b-8fbb-8d8cdd35220c service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:01:53.194015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c17843-25c0-4c8b-8fbb-8d8cdd35220c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:01:53.203600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c17843-25c0-4c8b-8fbb-8d8cdd35220c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:01:53.205178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c17843-25c0-4c8b-8fbb-8d8cdd35220c service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:01:53.215047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 711/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:01:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:14.972540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe52e35-bf3f-4596-bee0-393fc8ce0574 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.973127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe52e35-bf3f-4596-bee0-393fc8ce0574 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.973127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe52e35-bf3f-4596-bee0-393fc8ce0574 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.974407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 699/1410] 10.222.0.49 () {54 vars in 918 bytes} [Tue May 10 21:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:14.979821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895faf1b-6158-4df5-9964-7d6a4d88f035 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:14.980313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895faf1b-6158-4df5-9964-7d6a4d88f035 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:14.980417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895faf1b-6158-4df5-9964-7d6a4d88f035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:14.999630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-895faf1b-6158-4df5-9964-7d6a4d88f035 None None] MFA Rules not processed for user `e538db4da67443e286408deb9663a083`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:15.000978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-895faf1b-6158-4df5-9964-7d6a4d88f035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:15.009235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 712/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Tue May 10 21:02:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:15.024334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd89f-a8ed-4204-a781-384955280390 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.024619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd89f-a8ed-4204-a781-384955280390 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.024896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecfd89f-a8ed-4204-a781-384955280390 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.026257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 700/1412] 10.222.0.49 () {54 vars in 918 bytes} [Tue May 10 21:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:15.031685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05986d-22f0-403b-b05c-4fe2106f4e18 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:15.031974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05986d-22f0-403b-b05c-4fe2106f4e18 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:15.032278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05986d-22f0-403b-b05c-4fe2106f4e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:15.049918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-de05986d-22f0-403b-b05c-4fe2106f4e18 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:15.051126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-de05986d-22f0-403b-b05c-4fe2106f4e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:15.060349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 713/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Tue May 10 21:02:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:17.729510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff247-d491-4e42-9606-972e64836f84 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.730065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff247-d491-4e42-9606-972e64836f84 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.730065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ff247-d491-4e42-9606-972e64836f84 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.731442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:17.737041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ed7ef-b301-4f40-bfcd-12acddd3a7a9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.737463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ed7ef-b301-4f40-bfcd-12acddd3a7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.737605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ed7ef-b301-4f40-bfcd-12acddd3a7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.755762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cd6ed7ef-b301-4f40-bfcd-12acddd3a7a9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:17.756963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cd6ed7ef-b301-4f40-bfcd-12acddd3a7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:17.765389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:17.805170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff247-d491-4e42-9606-972e64836f84 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:17.819676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ff247-d491-4e42-9606-972e64836f84 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:17.824965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b1ef2f-0312-4d7c-ba5d-7c57c7c0e30d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:17.825597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1ef2f-0312-4d7c-ba5d-7c57c7c0e30d service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:17.825881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1ef2f-0312-4d7c-ba5d-7c57c7c0e30d service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:17.826160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b1ef2f-0312-4d7c-ba5d-7c57c7c0e30d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:17.834727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1ef2f-0312-4d7c-ba5d-7c57c7c0e30d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:17.836330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b1ef2f-0312-4d7c-ba5d-7c57c7c0e30d service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:17.845643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 702/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:18.826260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2cf7e-73ea-49d6-8d55-8dd62c1c88c6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:18.826829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2cf7e-73ea-49d6-8d55-8dd62c1c88c6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:18.826829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e2cf7e-73ea-49d6-8d55-8dd62c1c88c6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:18.829008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:18.833831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a13ba-05cb-4ff0-b3b0-012b3a91928d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:18.834266 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a13ba-05cb-4ff0-b3b0-012b3a91928d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:18.834385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a13ba-05cb-4ff0-b3b0-012b3a91928d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:18.852809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8c5a13ba-05cb-4ff0-b3b0-012b3a91928d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:18.854001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8c5a13ba-05cb-4ff0-b3b0-012b3a91928d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:18.862075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:19.020674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2cf7e-73ea-49d6-8d55-8dd62c1c88c6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:19.035076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e2cf7e-73ea-49d6-8d55-8dd62c1c88c6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:19.040416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b12b3-c6db-49c7-9aa5-d23a44f3bf15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:19.041055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b12b3-c6db-49c7-9aa5-d23a44f3bf15 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:19.041337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b12b3-c6db-49c7-9aa5-d23a44f3bf15 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:19.041613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b12b3-c6db-49c7-9aa5-d23a44f3bf15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:19.049888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b12b3-c6db-49c7-9aa5-d23a44f3bf15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:19.051486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b12b3-c6db-49c7-9aa5-d23a44f3bf15 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:19.060878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 716/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:20.011426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ad6f1-f6ce-4289-a0c6-631e86d3d88f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.011976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ad6f1-f6ce-4289-a0c6-631e86d3d88f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.011976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ad6f1-f6ce-4289-a0c6-631e86d3d88f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.013387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:20.018954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac4a2b-84fd-407f-816c-df3a9eb0d555 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.019397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac4a2b-84fd-407f-816c-df3a9eb0d555 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.019540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac4a2b-84fd-407f-816c-df3a9eb0d555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.037595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5dac4a2b-84fd-407f-816c-df3a9eb0d555 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:20.038978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5dac4a2b-84fd-407f-816c-df3a9eb0d555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:20.047383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:20.199680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ad6f1-f6ce-4289-a0c6-631e86d3d88f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:20.214602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ad6f1-f6ce-4289-a0c6-631e86d3d88f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:20.220041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99fc170-b4a5-41eb-89f6-b9334530d32a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:20.220678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc170-b4a5-41eb-89f6-b9334530d32a service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:20.220965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc170-b4a5-41eb-89f6-b9334530d32a service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:20.221246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99fc170-b4a5-41eb-89f6-b9334530d32a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:20.229502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc170-b4a5-41eb-89f6-b9334530d32a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:20.231088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99fc170-b4a5-41eb-89f6-b9334530d32a service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:20.241219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 705/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:21.166790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32d8a-a27e-43c9-9623-66c794318e9e None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.167404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32d8a-a27e-43c9-9623-66c794318e9e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.167404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd32d8a-a27e-43c9-9623-66c794318e9e None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.168801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:21.174525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f76b-509b-4b54-9f3e-d730e17b502b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.174971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f76b-509b-4b54-9f3e-d730e17b502b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.175070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f76b-509b-4b54-9f3e-d730e17b502b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.193770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-55d4f76b-509b-4b54-9f3e-d730e17b502b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:21.194960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-55d4f76b-509b-4b54-9f3e-d730e17b502b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:21.202943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:21.351240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd32d8a-a27e-43c9-9623-66c794318e9e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:21.365632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd32d8a-a27e-43c9-9623-66c794318e9e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:21.370872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aae5a4-ac9b-4e99-9298-9bf7781bae14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:21.371632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aae5a4-ac9b-4e99-9298-9bf7781bae14 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:21.371910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aae5a4-ac9b-4e99-9298-9bf7781bae14 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:21.372179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aae5a4-ac9b-4e99-9298-9bf7781bae14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:21.380822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aae5a4-ac9b-4e99-9298-9bf7781bae14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:21.382394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aae5a4-ac9b-4e99-9298-9bf7781bae14 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:21.391737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 719/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:22.341624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab772-b506-4b87-918e-ff82155a03e9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.342206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab772-b506-4b87-918e-ff82155a03e9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.342206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ab772-b506-4b87-918e-ff82155a03e9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.343612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:22.348522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474615af-51bc-4137-a4a3-64fe75d19057 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.348932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474615af-51bc-4137-a4a3-64fe75d19057 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.349075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474615af-51bc-4137-a4a3-64fe75d19057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.366805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-474615af-51bc-4137-a4a3-64fe75d19057 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:22.368018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-474615af-51bc-4137-a4a3-64fe75d19057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:22.376280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:22.530155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab772-b506-4b87-918e-ff82155a03e9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:22.544138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ab772-b506-4b87-918e-ff82155a03e9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:22.550158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c7df8-cddd-4db8-869b-d007dc98eb4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:22.550803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7df8-cddd-4db8-869b-d007dc98eb4e service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:22.551086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7df8-cddd-4db8-869b-d007dc98eb4e service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:22.551401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c7df8-cddd-4db8-869b-d007dc98eb4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:22.560001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c7df8-cddd-4db8-869b-d007dc98eb4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:22.562284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c7df8-cddd-4db8-869b-d007dc98eb4e service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:22.571872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 708/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:23.501386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49126f-453e-4c29-b38b-31c353fdb80b None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.501976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49126f-453e-4c29-b38b-31c353fdb80b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.501976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd49126f-453e-4c29-b38b-31c353fdb80b None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.503333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:23.508216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f0b2-0a3e-4667-a1a4-7519be77f49d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.508654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f0b2-0a3e-4667-a1a4-7519be77f49d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.508782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f0b2-0a3e-4667-a1a4-7519be77f49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.526255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e360f0b2-0a3e-4667-a1a4-7519be77f49d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:23.527491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e360f0b2-0a3e-4667-a1a4-7519be77f49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:23.535431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:23.686508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49126f-453e-4c29-b38b-31c353fdb80b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:23.700468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd49126f-453e-4c29-b38b-31c353fdb80b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:23.705881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95192ad8-6fc2-419f-94d6-5291ca170b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:23.706505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192ad8-6fc2-419f-94d6-5291ca170b9e service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:23.706788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192ad8-6fc2-419f-94d6-5291ca170b9e service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:23.707064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95192ad8-6fc2-419f-94d6-5291ca170b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:23.714918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95192ad8-6fc2-419f-94d6-5291ca170b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:23.716513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95192ad8-6fc2-419f-94d6-5291ca170b9e service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:23.726485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 722/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:24.650103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547494c-5373-4bf8-9818-619021f7f4e9 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.650599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547494c-5373-4bf8-9818-619021f7f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.650719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547494c-5373-4bf8-9818-619021f7f4e9 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.652076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:24.657880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae139a42-50ca-4bcc-a553-e236c0d58398 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.660051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae139a42-50ca-4bcc-a553-e236c0d58398 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.660051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae139a42-50ca-4bcc-a553-e236c0d58398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.677097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ae139a42-50ca-4bcc-a553-e236c0d58398 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:24.678295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ae139a42-50ca-4bcc-a553-e236c0d58398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:24.686259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:24.837203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547494c-5373-4bf8-9818-619021f7f4e9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:24.851986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547494c-5373-4bf8-9818-619021f7f4e9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:24.860250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c2d56e-88be-4777-b497-b260b6848277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:24.860250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d56e-88be-4777-b497-b260b6848277 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:24.860250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d56e-88be-4777-b497-b260b6848277 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:24.860250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2d56e-88be-4777-b497-b260b6848277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:24.866814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2d56e-88be-4777-b497-b260b6848277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:24.868564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c2d56e-88be-4777-b497-b260b6848277 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:24.878172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 711/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:25.821622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67d848-6ef0-4256-883f-6403674e5302 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.822151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67d848-6ef0-4256-883f-6403674e5302 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.822151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67d848-6ef0-4256-883f-6403674e5302 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.823513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:25.828645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3480e-2886-4760-9454-ed59edd2f5bd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:25.829060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3480e-2886-4760-9454-ed59edd2f5bd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:25.829220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3480e-2886-4760-9454-ed59edd2f5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:25.846924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6fd3480e-2886-4760-9454-ed59edd2f5bd None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:25.848176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6fd3480e-2886-4760-9454-ed59edd2f5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:25.856078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:26.007601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67d848-6ef0-4256-883f-6403674e5302 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:26.021665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67d848-6ef0-4256-883f-6403674e5302 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:26.027034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743f68e-4289-4069-9885-ca2486bb10ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:26.027693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743f68e-4289-4069-9885-ca2486bb10ad service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.027976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743f68e-4289-4069-9885-ca2486bb10ad service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.028246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743f68e-4289-4069-9885-ca2486bb10ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.036932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743f68e-4289-4069-9885-ca2486bb10ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:26.038597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f743f68e-4289-4069-9885-ca2486bb10ad service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:26.048307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 725/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:26.982757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d3a4-9b09-420e-9801-e39e0d58808c None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.983371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d3a4-9b09-420e-9801-e39e0d58808c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.983371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82d3a4-9b09-420e-9801-e39e0d58808c None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:26.984851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:26.989966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e1f0-469a-4358-b0e3-3612be5a8736 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:26.990374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e1f0-469a-4358-b0e3-3612be5a8736 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:26.990507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5e1f0-469a-4358-b0e3-3612be5a8736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.008448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-63a5e1f0-469a-4358-b0e3-3612be5a8736 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:27.009638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-63a5e1f0-469a-4358-b0e3-3612be5a8736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:27.017882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:27.164418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82d3a4-9b09-420e-9801-e39e0d58808c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:27.179103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a82d3a4-9b09-420e-9801-e39e0d58808c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:27.184696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b8e73-f124-43fa-820d-a55e493a559c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:27.185332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b8e73-f124-43fa-820d-a55e493a559c service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:27.185617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b8e73-f124-43fa-820d-a55e493a559c service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:27.185898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b8e73-f124-43fa-820d-a55e493a559c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:27.194498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b8e73-f124-43fa-820d-a55e493a559c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:27.196115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b8e73-f124-43fa-820d-a55e493a559c service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:27.205417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 714/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:29.315025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7201-fdf4-4453-96fd-4911d7df62d3 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.315654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7201-fdf4-4453-96fd-4911d7df62d3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.315654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e7201-fdf4-4453-96fd-4911d7df62d3 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.316989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:29.322396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337bba-509a-4730-b1aa-a5fdc54df57b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.322805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337bba-509a-4730-b1aa-a5fdc54df57b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.322979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337bba-509a-4730-b1aa-a5fdc54df57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.340791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b7337bba-509a-4730-b1aa-a5fdc54df57b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:29.341991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7337bba-509a-4730-b1aa-a5fdc54df57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:29.350425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:29.387971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7201-fdf4-4453-96fd-4911d7df62d3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:29.399093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e7201-fdf4-4453-96fd-4911d7df62d3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:29.402542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f02f-2b68-4bed-bd27-4362b3c6b270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:29.403192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f02f-2b68-4bed-bd27-4362b3c6b270 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:29.403475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f02f-2b68-4bed-bd27-4362b3c6b270 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:29.403750 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f02f-2b68-4bed-bd27-4362b3c6b270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:29.412896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f02f-2b68-4bed-bd27-4362b3c6b270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:29.414308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f02f-2b68-4bed-bd27-4362b3c6b270 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:29.423935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 728/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:31.785850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69f083-5dc1-4fb1-97e3-38e6a762e120 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.786424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69f083-5dc1-4fb1-97e3-38e6a762e120 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.786424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee69f083-5dc1-4fb1-97e3-38e6a762e120 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.787836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:31.793303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d29987-c527-477c-a522-8980490fc586 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.793742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d29987-c527-477c-a522-8980490fc586 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.793854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d29987-c527-477c-a522-8980490fc586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.813413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-93d29987-c527-477c-a522-8980490fc586 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:31.814551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-93d29987-c527-477c-a522-8980490fc586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:31.822277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:02:31.860403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69f083-5dc1-4fb1-97e3-38e6a762e120 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:31.870770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee69f083-5dc1-4fb1-97e3-38e6a762e120 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:31.875038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c05eda6-10d2-4abf-b746-4c4135395a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:31.875724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05eda6-10d2-4abf-b746-4c4135395a01 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:31.876014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05eda6-10d2-4abf-b746-4c4135395a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:31.876290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c05eda6-10d2-4abf-b746-4c4135395a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:31.885037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05eda6-10d2-4abf-b746-4c4135395a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:31.886504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c05eda6-10d2-4abf-b746-4c4135395a01 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:31.895879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 717/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:34.495478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d398-099c-42e0-b901-ef4f06906571 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.496155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d398-099c-42e0-b901-ef4f06906571 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.496155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9d398-099c-42e0-b901-ef4f06906571 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.497397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:02:34.503115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4908d-1c5d-414b-8959-9bbc9ade223a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.503549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4908d-1c5d-414b-8959-9bbc9ade223a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.503706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4908d-1c5d-414b-8959-9bbc9ade223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.521564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-68c4908d-1c5d-414b-8959-9bbc9ade223a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:34.522766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-68c4908d-1c5d-414b-8959-9bbc9ade223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:34.531369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:34.569876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d398-099c-42e0-b901-ef4f06906571 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:34.581089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9d398-099c-42e0-b901-ef4f06906571 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:34.584565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f1c6c-31d5-41d9-8770-95d03b490e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:34.585195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1c6c-31d5-41d9-8770-95d03b490e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:34.585507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1c6c-31d5-41d9-8770-95d03b490e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:34.585784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f1c6c-31d5-41d9-8770-95d03b490e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:34.595037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f1c6c-31d5-41d9-8770-95d03b490e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:34.596525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f1c6c-31d5-41d9-8770-95d03b490e14 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:34.607153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 731/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:36.930644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ae93-9b24-44ca-986e-a14d3c72640e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:36.931203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ae93-9b24-44ca-986e-a14d3c72640e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:36.931203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406ae93-9b24-44ca-986e-a14d3c72640e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:36.932591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:36.937820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8272d-0d46-40c3-8172-775625b61532 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:36.938247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8272d-0d46-40c3-8172-775625b61532 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:36.938372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8272d-0d46-40c3-8172-775625b61532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:36.956416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f0d8272d-0d46-40c3-8172-775625b61532 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:36.957617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f0d8272d-0d46-40c3-8172-775625b61532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:36.965340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:37.004179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ae93-9b24-44ca-986e-a14d3c72640e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:37.014567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406ae93-9b24-44ca-986e-a14d3c72640e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:37.018183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9d243-5dfc-4621-bdbf-cede77f0ede0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:37.018820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9d243-5dfc-4621-bdbf-cede77f0ede0 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:37.019102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9d243-5dfc-4621-bdbf-cede77f0ede0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:37.019413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9d243-5dfc-4621-bdbf-cede77f0ede0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:37.028273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9d243-5dfc-4621-bdbf-cede77f0ede0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:37.029690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9d243-5dfc-4621-bdbf-cede77f0ede0 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:37.038876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 720/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:02:39.324339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45417c-64bc-4b2b-b34c-e19c78474423 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.324890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45417c-64bc-4b2b-b34c-e19c78474423 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.324890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d45417c-64bc-4b2b-b34c-e19c78474423 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.326276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:39.331931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22300365-667a-4cee-8579-7aa29f9faa01 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.332378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22300365-667a-4cee-8579-7aa29f9faa01 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.332486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22300365-667a-4cee-8579-7aa29f9faa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.349755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-22300365-667a-4cee-8579-7aa29f9faa01 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:39.350936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22300365-667a-4cee-8579-7aa29f9faa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:39.359003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:39.396817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45417c-64bc-4b2b-b34c-e19c78474423 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:39.407652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d45417c-64bc-4b2b-b34c-e19c78474423 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:39.411386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269164d-57e1-41aa-ba42-28365ee55c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:39.412033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269164d-57e1-41aa-ba42-28365ee55c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:39.412315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269164d-57e1-41aa-ba42-28365ee55c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:39.412591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269164d-57e1-41aa-ba42-28365ee55c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:39.421966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269164d-57e1-41aa-ba42-28365ee55c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:39.423414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269164d-57e1-41aa-ba42-28365ee55c70 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:39.432799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 734/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:41.715901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5be5-0ade-4c71-a94f-bdc95b691f6b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.716483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5be5-0ade-4c71-a94f-bdc95b691f6b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.716483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b5be5-0ade-4c71-a94f-bdc95b691f6b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.718600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:41.724080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add6d79-d416-436b-850b-a801efba65c7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.724492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add6d79-d416-436b-850b-a801efba65c7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.724647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add6d79-d416-436b-850b-a801efba65c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.742504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4add6d79-d416-436b-850b-a801efba65c7 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:41.743737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4add6d79-d416-436b-850b-a801efba65c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:41.751582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:41.788671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5be5-0ade-4c71-a94f-bdc95b691f6b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:41.799649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b5be5-0ade-4c71-a94f-bdc95b691f6b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:41.803094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5a6b4-b06b-4920-acd9-939a1f321b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:41.803767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a6b4-b06b-4920-acd9-939a1f321b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:41.804047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a6b4-b06b-4920-acd9-939a1f321b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:41.804324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5a6b4-b06b-4920-acd9-939a1f321b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:41.813801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a6b4-b06b-4920-acd9-939a1f321b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:41.815272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce5a6b4-b06b-4920-acd9-939a1f321b79 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:41.824502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 723/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:02:44.097651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db329522-f5a1-443f-b949-b680865f18de None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.098233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db329522-f5a1-443f-b949-b680865f18de None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.098233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db329522-f5a1-443f-b949-b680865f18de None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.099596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:44.104916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92b37-a684-41dc-a5df-c5908166eeae None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.105333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92b37-a684-41dc-a5df-c5908166eeae None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.105472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c92b37-a684-41dc-a5df-c5908166eeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.126924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-89c92b37-a684-41dc-a5df-c5908166eeae None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:44.128619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-89c92b37-a684-41dc-a5df-c5908166eeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:44.137889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:44.175005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db329522-f5a1-443f-b949-b680865f18de None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:44.185638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db329522-f5a1-443f-b949-b680865f18de None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:44.189339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37655366-9d58-4f00-be93-6626a7b6fc05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:44.189971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37655366-9d58-4f00-be93-6626a7b6fc05 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:44.190254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37655366-9d58-4f00-be93-6626a7b6fc05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:44.190533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37655366-9d58-4f00-be93-6626a7b6fc05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:44.199101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37655366-9d58-4f00-be93-6626a7b6fc05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:44.200550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37655366-9d58-4f00-be93-6626a7b6fc05 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:44.209821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 737/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:46.455283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5974-b17c-4c1c-ab6e-57c7bdc27e98 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.455827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5974-b17c-4c1c-ab6e-57c7bdc27e98 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.455827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d5974-b17c-4c1c-ab6e-57c7bdc27e98 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.457229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:46.462446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8f33-2704-446f-b24f-19dec0044224 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.462882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8f33-2704-446f-b24f-19dec0044224 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.463114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003f8f33-2704-446f-b24f-19dec0044224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.480274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-003f8f33-2704-446f-b24f-19dec0044224 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:46.481454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-003f8f33-2704-446f-b24f-19dec0044224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:46.489652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:46.525617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5974-b17c-4c1c-ab6e-57c7bdc27e98 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:46.536127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d5974-b17c-4c1c-ab6e-57c7bdc27e98 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:46.539598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f245e1-ff5b-4804-84f0-4393e39d27bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:46.540229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f245e1-ff5b-4804-84f0-4393e39d27bd service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:46.540506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f245e1-ff5b-4804-84f0-4393e39d27bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:46.540780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f245e1-ff5b-4804-84f0-4393e39d27bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:46.550002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f245e1-ff5b-4804-84f0-4393e39d27bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:46.551458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f245e1-ff5b-4804-84f0-4393e39d27bd service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:46.560843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 726/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:48.799395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a547c-3953-4dda-b5b7-3ee93ea97bbb None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.799955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a547c-3953-4dda-b5b7-3ee93ea97bbb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.799955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a547c-3953-4dda-b5b7-3ee93ea97bbb None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.801332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:48.807074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc5a4-8b23-4b00-b687-239971f736da None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.807548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc5a4-8b23-4b00-b687-239971f736da None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.807659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc5a4-8b23-4b00-b687-239971f736da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.825671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-02afc5a4-8b23-4b00-b687-239971f736da None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:48.827075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02afc5a4-8b23-4b00-b687-239971f736da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:48.834638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:48.870070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a547c-3953-4dda-b5b7-3ee93ea97bbb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:48.881163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a547c-3953-4dda-b5b7-3ee93ea97bbb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:48.884597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf0f3b-f3b0-43aa-bcb0-2fce6acbd1e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:48.885223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf0f3b-f3b0-43aa-bcb0-2fce6acbd1e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:48.885501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf0f3b-f3b0-43aa-bcb0-2fce6acbd1e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:48.885771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf0f3b-f3b0-43aa-bcb0-2fce6acbd1e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:48.894327 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf0f3b-f3b0-43aa-bcb0-2fce6acbd1e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:48.895772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf0f3b-f3b0-43aa-bcb0-2fce6acbd1e9 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:48.905097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 740/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:02:51.125323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb5f8-f151-4a23-b9fe-db6c72fec6e3 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:51.125895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb5f8-f151-4a23-b9fe-db6c72fec6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:51.125895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fb5f8-f151-4a23-b9fe-db6c72fec6e3 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:51.127300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:02:51.132577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab5eac-adcf-482e-9f08-e376e33a51f8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:51.132973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab5eac-adcf-482e-9f08-e376e33a51f8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:51.133139 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab5eac-adcf-482e-9f08-e376e33a51f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:51.150724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b2ab5eac-adcf-482e-9f08-e376e33a51f8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:02:51.151948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b2ab5eac-adcf-482e-9f08-e376e33a51f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:02:51.160318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:02:51.196724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb5f8-f151-4a23-b9fe-db6c72fec6e3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:02:51.207586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fb5f8-f151-4a23-b9fe-db6c72fec6e3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:02:51.211031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b07a382-6330-46fd-8a4a-87575b78706b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:02:51.211689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a382-6330-46fd-8a4a-87575b78706b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:02:51.211967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a382-6330-46fd-8a4a-87575b78706b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:02:51.212241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b07a382-6330-46fd-8a4a-87575b78706b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:02:51.221520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07a382-6330-46fd-8a4a-87575b78706b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:02:51.222934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b07a382-6330-46fd-8a4a-87575b78706b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:02:51.232012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 729/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:02:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:03:24.796559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6f45-bd32-44ba-b3cc-f79003e71919 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:24.797173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6f45-bd32-44ba-b3cc-f79003e71919 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:24.797173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc6f45-bd32-44ba-b3cc-f79003e71919 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:24.798475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 742/1471] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:24.803619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a46d-a526-4982-8dc7-d535a5452669 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:24.804037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a46d-a526-4982-8dc7-d535a5452669 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:24.804174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1a46d-a526-4982-8dc7-d535a5452669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:24.822509 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-79e1a46d-a526-4982-8dc7-d535a5452669 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:24.823744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-79e1a46d-a526-4982-8dc7-d535a5452669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:24.831726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 730/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:24.879218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16402d-3f23-437c-81d1-a04368d6ad98 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:24.879508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16402d-3f23-437c-81d1-a04368d6ad98 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:24.879889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16402d-3f23-437c-81d1-a04368d6ad98 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:24.881263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 743/1473] 10.222.0.49 () {54 vars in 962 bytes} [Tue May 10 21:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:24.886640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980de40-30ed-483e-80ff-a4aa7fb57f9f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:24.886935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980de40-30ed-483e-80ff-a4aa7fb57f9f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:24.887241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980de40-30ed-483e-80ff-a4aa7fb57f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:24.905210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1980de40-30ed-483e-80ff-a4aa7fb57f9f None None] MFA Rules not processed for user `69f37dda98124a8c8cf4406d985933f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:24.906412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1980de40-30ed-483e-80ff-a4aa7fb57f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:24.913033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 731/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Tue May 10 21:03:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:24.920977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16402d-3f23-437c-81d1-a04368d6ad98 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:24.931838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16402d-3f23-437c-81d1-a04368d6ad98 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:24.935990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ec32e-fcbe-41bd-918c-1fd539cc3a97 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f37dda98124a8c8cf4406d985933f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:24.936786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ec32e-fcbe-41bd-918c-1fd539cc3a97 service glance] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:24.937076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ec32e-fcbe-41bd-918c-1fd539cc3a97 service glance] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:24.937348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ec32e-fcbe-41bd-918c-1fd539cc3a97 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:24.946026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ec32e-fcbe-41bd-918c-1fd539cc3a97 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:24.947476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ec32e-fcbe-41bd-918c-1fd539cc3a97 service glance] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:24.956590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 744/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:03:27.274296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195913d-fb9f-4894-8969-2e399d71b705 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:27.274833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195913d-fb9f-4894-8969-2e399d71b705 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:27.274953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195913d-fb9f-4894-8969-2e399d71b705 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:27.276267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 732/1476] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:03:27.282660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95207-34d8-41c2-aa99-8c99374f39c4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:27.288129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95207-34d8-41c2-aa99-8c99374f39c4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:27.288129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a95207-34d8-41c2-aa99-8c99374f39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:27.302075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b1a95207-34d8-41c2-aa99-8c99374f39c4 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:27.303301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b1a95207-34d8-41c2-aa99-8c99374f39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:27.311896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 745/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:27.335618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195913d-fb9f-4894-8969-2e399d71b705 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:27.348809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195913d-fb9f-4894-8969-2e399d71b705 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:27.353309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5040e318-f7bd-4573-8437-461cf3b327d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:27.360064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e318-f7bd-4573-8437-461cf3b327d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:27.360064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e318-f7bd-4573-8437-461cf3b327d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:27.360064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5040e318-f7bd-4573-8437-461cf3b327d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:27.360064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040e318-f7bd-4573-8437-461cf3b327d7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:27.360064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-5040e318-f7bd-4573-8437-461cf3b327d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:03:27.360064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:03:27.360064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:03:27.360725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5040e318-f7bd-4573-8437-461cf3b327d7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:27.377593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 733/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Tue May 10 21:03:27 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:03:29.598652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf38c8-a569-428b-9de0-044750c320b6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.599464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf38c8-a569-428b-9de0-044750c320b6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.599924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf38c8-a569-428b-9de0-044750c320b6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.601701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 746/1479] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:29.607892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2346c-6fea-4376-8145-dd7395df1f91 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.608449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2346c-6fea-4376-8145-dd7395df1f91 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.608564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2346c-6fea-4376-8145-dd7395df1f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.626537 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-97f2346c-6fea-4376-8145-dd7395df1f91 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:29.627766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-97f2346c-6fea-4376-8145-dd7395df1f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:29.635508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 734/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:29.677463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf38c8-a569-428b-9de0-044750c320b6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:29.691576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf38c8-a569-428b-9de0-044750c320b6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:29.696948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f172c-a23e-4b40-9296-09808cc0293c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:29.697581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f172c-a23e-4b40-9296-09808cc0293c service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:29.697856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f172c-a23e-4b40-9296-09808cc0293c service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:29.698126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f172c-a23e-4b40-9296-09808cc0293c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:29.705929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f172c-a23e-4b40-9296-09808cc0293c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:29.707517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f172c-a23e-4b40-9296-09808cc0293c service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:29.717417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 747/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:03:32.087800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752a1c4-3c2e-4315-a3ae-a30c23dafa9f None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.088365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752a1c4-3c2e-4315-a3ae-a30c23dafa9f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.088365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752a1c4-3c2e-4315-a3ae-a30c23dafa9f None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.089718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 735/1482] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:32.095453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4e666-18db-4dc1-af36-55cb9afc2c97 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.095909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4e666-18db-4dc1-af36-55cb9afc2c97 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.096025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4e666-18db-4dc1-af36-55cb9afc2c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.114047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3fa4e666-18db-4dc1-af36-55cb9afc2c97 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:32.115283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3fa4e666-18db-4dc1-af36-55cb9afc2c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:32.123107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 748/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:32.157920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752a1c4-3c2e-4315-a3ae-a30c23dafa9f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:32.168218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752a1c4-3c2e-4315-a3ae-a30c23dafa9f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:32.172794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6913a2-5e23-4ebd-af7c-2914641f0c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:32.173420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6913a2-5e23-4ebd-af7c-2914641f0c31 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:32.173697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6913a2-5e23-4ebd-af7c-2914641f0c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:32.173968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6913a2-5e23-4ebd-af7c-2914641f0c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:32.182946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6913a2-5e23-4ebd-af7c-2914641f0c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:32.184390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6913a2-5e23-4ebd-af7c-2914641f0c31 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:32.193433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 736/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:03:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:03:34.476229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80becf6-2eba-4f74-839c-771168bae295 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:34.476795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80becf6-2eba-4f74-839c-771168bae295 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:34.476795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80becf6-2eba-4f74-839c-771168bae295 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:34.478278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 749/1485] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:34.483569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02179e8-59b3-4f56-b020-87e0c359f24f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:34.483994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02179e8-59b3-4f56-b020-87e0c359f24f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:34.484124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02179e8-59b3-4f56-b020-87e0c359f24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:34.502035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d02179e8-59b3-4f56-b020-87e0c359f24f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:34.503249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d02179e8-59b3-4f56-b020-87e0c359f24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:34.510947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 737/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:34.550495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80becf6-2eba-4f74-839c-771168bae295 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:34.561669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80becf6-2eba-4f74-839c-771168bae295 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:34.565168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48de8ce0-d304-42f1-bb92-0d31784a3319 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:34.565801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de8ce0-d304-42f1-bb92-0d31784a3319 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:34.566081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de8ce0-d304-42f1-bb92-0d31784a3319 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:34.566360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de8ce0-d304-42f1-bb92-0d31784a3319 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:34.574976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de8ce0-d304-42f1-bb92-0d31784a3319 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:34.576460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48de8ce0-d304-42f1-bb92-0d31784a3319 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:34.585566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 750/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:03:36.884349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0d8b-85d5-492d-af8f-2aa17b0c1fb5 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:36.884922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0d8b-85d5-492d-af8f-2aa17b0c1fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:36.884922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc0d8b-85d5-492d-af8f-2aa17b0c1fb5 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:36.886197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 738/1488] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:36.892307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0f67a-726a-44dc-a562-2dce3be82ec8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:36.892742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0f67a-726a-44dc-a562-2dce3be82ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:36.892898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0f67a-726a-44dc-a562-2dce3be82ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:36.910634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-eea0f67a-726a-44dc-a562-2dce3be82ec8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:36.911868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-eea0f67a-726a-44dc-a562-2dce3be82ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:36.919704 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 751/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:36.959196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0d8b-85d5-492d-af8f-2aa17b0c1fb5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:36.970314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc0d8b-85d5-492d-af8f-2aa17b0c1fb5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:36.973800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab86c4e3-c7c6-4c1d-bdf0-f61c0a6949b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:36.974425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c4e3-c7c6-4c1d-bdf0-f61c0a6949b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:36.974708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c4e3-c7c6-4c1d-bdf0-f61c0a6949b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:36.975011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab86c4e3-c7c6-4c1d-bdf0-f61c0a6949b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:36.983920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c4e3-c7c6-4c1d-bdf0-f61c0a6949b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:36.985375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab86c4e3-c7c6-4c1d-bdf0-f61c0a6949b1 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:36.994470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 739/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:03:39.658324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a9cc-6466-44f7-8f90-a44371427323 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:39.658864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a9cc-6466-44f7-8f90-a44371427323 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:39.658971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3a9cc-6466-44f7-8f90-a44371427323 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:39.660313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 752/1491] 10.222.0.49 () {54 vars in 926 bytes} [Tue May 10 21:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:03:39.665623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25d304-2d9d-4c0e-8c59-6e337d04fba8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:39.666072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25d304-2d9d-4c0e-8c59-6e337d04fba8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:39.666191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a25d304-2d9d-4c0e-8c59-6e337d04fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:39.684520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0a25d304-2d9d-4c0e-8c59-6e337d04fba8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:03:39.685818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a25d304-2d9d-4c0e-8c59-6e337d04fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:03:39.693515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 740/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Tue May 10 21:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:03:39.731726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3a9cc-6466-44f7-8f90-a44371427323 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:03:39.742670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3a9cc-6466-44f7-8f90-a44371427323 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:03:39.746133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5ad7d-a04b-44c2-8f09-3f11d81128e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:03:39.746768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ad7d-a04b-44c2-8f09-3f11d81128e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:03:39.747053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ad7d-a04b-44c2-8f09-3f11d81128e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:03:39.747370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5ad7d-a04b-44c2-8f09-3f11d81128e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:03:39.756075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5ad7d-a04b-44c2-8f09-3f11d81128e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:03:39.757492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5ad7d-a04b-44c2-8f09-3f11d81128e0 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:03:39.767189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 753/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:05:15.010165 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951016b7-5f63-4844-8db2-e09eda0eb7db None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.010746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951016b7-5f63-4844-8db2-e09eda0eb7db None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.010746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951016b7-5f63-4844-8db2-e09eda0eb7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.029030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-951016b7-5f63-4844-8db2-e09eda0eb7db None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:15.030227 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-951016b7-5f63-4844-8db2-e09eda0eb7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:15.038127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 741/1494] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:05:15.047971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b484f34-95b4-46a1-93d7-404f747ac729 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.048480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b484f34-95b4-46a1-93d7-404f747ac729 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.048589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b484f34-95b4-46a1-93d7-404f747ac729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.065958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1b484f34-95b4-46a1-93d7-404f747ac729 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:15.067158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1b484f34-95b4-46a1-93d7-404f747ac729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:15.074812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 754/1495] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:05:15.079336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951016b7-5f63-4844-8db2-e09eda0eb7db None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.088814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951016b7-5f63-4844-8db2-e09eda0eb7db None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.093870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.094516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.094799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.095075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.095835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:05:15.096140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.097159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:15.097159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:05:15.097159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:05:15.098145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.109985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 742/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:05:15.117963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b484f34-95b4-46a1-93d7-404f747ac729 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.127433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b484f34-95b4-46a1-93d7-404f747ac729 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.131867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.132505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.132784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.133058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.133750 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.135516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING py.warnings [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:15.135516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: warnings.warn(msg) May 10 21:05:15.135516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: May 10 21:05:15.136693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.232889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 755/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:05:15 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:05:15.237039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.247629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787b875-c8ee-4bf8-828c-ff214f0f7023 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.302265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.302850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.303291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.303720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.304567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.305615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:15.305615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:05:15.305615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:05:15.307527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.374699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 743/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:05:15 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:05:15.378948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.388990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e39ca-bcfd-49ef-9878-2b8ce1c4ae36 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.393450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.394104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.394392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.394673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.395518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.396534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING py.warnings [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:15.396534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: warnings.warn(msg) May 10 21:05:15.396534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: May 10 21:05:15.397410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.409952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 756/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:05:15.414127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.424471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf504b15-c730-4614-a67b-37cd3a230555 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.429027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108d978-5bbe-45fd-acc8-bb3c014f9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.429681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d978-5bbe-45fd-acc8-bb3c014f9c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.429961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d978-5bbe-45fd-acc8-bb3c014f9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.430236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108d978-5bbe-45fd-acc8-bb3c014f9c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.430962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108d978-5bbe-45fd-acc8-bb3c014f9c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.432016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-8108d978-5bbe-45fd-acc8-bb3c014f9c87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:15.432016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:05:15.432016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:05:15.433175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108d978-5bbe-45fd-acc8-bb3c014f9c87 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.446833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 744/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:05:15.450938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.460710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d50cac9-c212-4f2c-b9ef-1c28eda85c9a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.465172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2879e-5fa9-4c7c-9f71-63530ec8889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.466071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2879e-5fa9-4c7c-9f71-63530ec8889a admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.466344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2879e-5fa9-4c7c-9f71-63530ec8889a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.466623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2879e-5fa9-4c7c-9f71-63530ec8889a admin admin] PATH_INFO: `/v3/projects/ff7cb949b6574372aaddbbeb0d5cf057/users/3061dbcf411543a7860067f640f02ccf/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.480713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2879e-5fa9-4c7c-9f71-63530ec8889a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7cb949b6574372aaddbbeb0d5cf057, user_id=3061dbcf411543a7860067f640f02ccf, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.482422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING py.warnings [None req-c4c2879e-5fa9-4c7c-9f71-63530ec8889a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:15.482422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: warnings.warn(msg) May 10 21:05:15.482422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: May 10 21:05:15.484384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2879e-5fa9-4c7c-9f71-63530ec8889a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.563935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 757/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:05:15 2022] PUT /identity/v3/projects/ff7cb949b6574372aaddbbeb0d5cf057/users/3061dbcf411543a7860067f640f02ccf/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:05:15.575437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585060-7818-45ba-bc3c-0ee544ad7c99 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.575732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585060-7818-45ba-bc3c-0ee544ad7c99 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.576013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db585060-7818-45ba-bc3c-0ee544ad7c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.602749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-db585060-7818-45ba-bc3c-0ee544ad7c99 None None] MFA Rules not processed for user `3061dbcf411543a7860067f640f02ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:15.603995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-db585060-7818-45ba-bc3c-0ee544ad7c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:15.666666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 745/1502] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:05:15.680186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1c1c-845d-4268-bf53-ef0cb48d64e7 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.680478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1c1c-845d-4268-bf53-ef0cb48d64e7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.680757 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe1c1c-845d-4268-bf53-ef0cb48d64e7 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.682420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 758/1503] 10.222.0.49 () {54 vars in 963 bytes} [Tue May 10 21:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 10 21:05:15.687826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a6b1-f450-47f0-8f67-487659ea018a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.688117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a6b1-f450-47f0-8f67-487659ea018a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.688395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517a6b1-f450-47f0-8f67-487659ea018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.706430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6517a6b1-f450-47f0-8f67-487659ea018a None None] MFA Rules not processed for user `8f2ddd09bc4743f585cda702c3047e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:15.707658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6517a6b1-f450-47f0-8f67-487659ea018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:15.755561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 746/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Tue May 10 21:05:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:05:15.762934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1c1c-845d-4268-bf53-ef0cb48d64e7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.773170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe1c1c-845d-4268-bf53-ef0cb48d64e7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.776593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.777213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.777490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.777761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.786696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.788152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:15.798800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 759/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:05:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:05:15.841579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac306-40ae-4efc-b5b7-ab83fce0b7bf None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.841935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac306-40ae-4efc-b5b7-ab83fce0b7bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.842215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cac306-40ae-4efc-b5b7-ab83fce0b7bf None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.843647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 747/1506] 10.222.0.49 () {52 vars in 829 bytes} [Tue May 10 21:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:05:15.847233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:15.907275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7328f62-b6d6-4d74-b36d-1b6105847a5c service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:15.911805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:15.912677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:15.912959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:15.913234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] PATH_INFO: `/v3/users/3061dbcf411543a7860067f640f02ccf` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:15.914419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3061dbcf411543a7860067f640f02ccf)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:15.915465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING py.warnings [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:15.915465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: warnings.warn(msg) May 10 21:05:15.915465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: May 10 21:05:15.916678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.152433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3061dbcf411543a7860067f640f02ccf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:16.220081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3061dbcf411543a7860067f640f02ccf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:16.238062 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3061dbcf411543a7860067f640f02ccf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:16.238729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3061dbcf411543a7860067f640f02ccf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:16.250901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3061dbcf411543a7860067f640f02ccf'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:16.257028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 760/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:05:15 2022] DELETE /identity/v3/users/3061dbcf411543a7860067f640f02ccf => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:05:16.261475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.261944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.262703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.280963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:05:16.282150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:16.337991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 748/1508] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:05:16.348023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:16.349413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:16.407660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766be7a3-2f45-4a5f-a4a0-7780158cd7ef admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:16.411078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe941c5c-5d25-42e8-bcc4-1c62942f4985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:16.411742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941c5c-5d25-42e8-bcc4-1c62942f4985 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.412020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941c5c-5d25-42e8-bcc4-1c62942f4985 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.412290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe941c5c-5d25-42e8-bcc4-1c62942f4985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.420997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe941c5c-5d25-42e8-bcc4-1c62942f4985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:16.422410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe941c5c-5d25-42e8-bcc4-1c62942f4985 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:16.431372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 761/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:05:16.879666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:05:16.881099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:05:16.893219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d0dd-b8d9-4d1d-8e4a-4e533756612f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:05:16.897774 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:05:16.898654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:05:16.898939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:05:16.899251 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] PATH_INFO: `/v3/projects/ff7cb949b6574372aaddbbeb0d5cf057` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:05:16.900500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7cb949b6574372aaddbbeb0d5cf057)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:05:16.901539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:05:16.901539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:05:16.901539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:05:16.902763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:05:17.002735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7cb949b6574372aaddbbeb0d5cf057', 'request_id': 'req-6c7e248a-5bad-4d88-8c64-a549eab3ce95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:17.060856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7cb949b6574372aaddbbeb0d5cf057', 'request_id': 'req-6c7e248a-5bad-4d88-8c64-a549eab3ce95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:17.067134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7cb949b6574372aaddbbeb0d5cf057', 'request_id': 'req-6c7e248a-5bad-4d88-8c64-a549eab3ce95'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:17.085271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] The token cache is being invalidate because project ff7cb949b6574372aaddbbeb0d5cf057 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:05:17.085556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:17.086382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6c7e248a-5bad-4d88-8c64-a549eab3ce95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:05:17.087938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 749/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:05:16 2022] DELETE /identity/v3/projects/ff7cb949b6574372aaddbbeb0d5cf057 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:06:54.922176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f630-ddd9-464b-b15f-7e6b0da843ff None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:54.922747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f630-ddd9-464b-b15f-7e6b0da843ff None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:54.922747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4f630-ddd9-464b-b15f-7e6b0da843ff None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:54.924161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:06:54.928974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e77d-4524-4d65-bdb0-1e0e6c2b8af3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:54.929436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e77d-4524-4d65-bdb0-1e0e6c2b8af3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:54.929549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146e77d-4524-4d65-bdb0-1e0e6c2b8af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:54.949075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c146e77d-4524-4d65-bdb0-1e0e6c2b8af3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:06:54.950309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c146e77d-4524-4d65-bdb0-1e0e6c2b8af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:06:55.009400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:06:55.175943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f630-ddd9-464b-b15f-7e6b0da843ff None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:06:55.177575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-17a4f630-ddd9-464b-b15f-7e6b0da843ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:06:55.249840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4f630-ddd9-464b-b15f-7e6b0da843ff None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:06:55.255151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f43d68-2979-411a-a90d-6c64a1696399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:06:55.255799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43d68-2979-411a-a90d-6c64a1696399 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:55.256080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43d68-2979-411a-a90d-6c64a1696399 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:55.256352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f43d68-2979-411a-a90d-6c64a1696399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:55.264330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f43d68-2979-411a-a90d-6c64a1696399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:06:55.265902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f43d68-2979-411a-a90d-6c64a1696399 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:06:55.274957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 763/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:06:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:06:55.810772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7283a4-9a37-4ee1-9aa1-c8e3a7eecaf0 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:55.811697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7283a4-9a37-4ee1-9aa1-c8e3a7eecaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:55.812025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7283a4-9a37-4ee1-9aa1-c8e3a7eecaf0 None None] PATH_INFO: `/v3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:55.813555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 751/1514] 10.222.0.71 () {54 vars in 925 bytes} [Tue May 10 21:06:55 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:06:55.819736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352e8a-9439-4337-b913-7fb34ddf69b8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:55.820032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352e8a-9439-4337-b913-7fb34ddf69b8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:55.820315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35352e8a-9439-4337-b913-7fb34ddf69b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:55.839257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-35352e8a-9439-4337-b913-7fb34ddf69b8 None None] MFA Rules not processed for user `e538db4da67443e286408deb9663a083`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:06:55.840467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-35352e8a-9439-4337-b913-7fb34ddf69b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:06:55.910766 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 764/1515] 10.222.0.71 () {58 vars in 1015 bytes} [Tue May 10 21:06:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:06:56.192468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89611c-ca29-4537-9dfd-1d6236489fa6 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:56.192955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89611c-ca29-4537-9dfd-1d6236489fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:56.193770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89611c-ca29-4537-9dfd-1d6236489fa6 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:56.194657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 752/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:06:56.199727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615c47-96dc-43e6-977e-115a09450901 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:56.200203 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615c47-96dc-43e6-977e-115a09450901 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:56.200306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7615c47-96dc-43e6-977e-115a09450901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:56.218609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a7615c47-96dc-43e6-977e-115a09450901 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:06:56.219826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a7615c47-96dc-43e6-977e-115a09450901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:06:56.227654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 765/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:06:56.377027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89611c-ca29-4537-9dfd-1d6236489fa6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:06:56.391887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89611c-ca29-4537-9dfd-1d6236489fa6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:06:56.397258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d19569-5aab-4da3-aa22-ab5ef5763c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:06:56.397899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d19569-5aab-4da3-aa22-ab5ef5763c60 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:56.398182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d19569-5aab-4da3-aa22-ab5ef5763c60 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:56.398462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d19569-5aab-4da3-aa22-ab5ef5763c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:56.406615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d19569-5aab-4da3-aa22-ab5ef5763c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:06:56.408238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d19569-5aab-4da3-aa22-ab5ef5763c60 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:06:56.417499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 753/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:06:59.895073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb398a-6c91-4a89-8cc1-faaf911163b8 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:59.897381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb398a-6c91-4a89-8cc1-faaf911163b8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:59.897381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb398a-6c91-4a89-8cc1-faaf911163b8 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:59.897381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 766/1519] 10.222.0.49 () {54 vars in 960 bytes} [Tue May 10 21:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:06:59.902405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f518-10e5-45ce-95f7-eef7fcefeb13 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:59.902831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f518-10e5-45ce-95f7-eef7fcefeb13 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:59.902984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f518-10e5-45ce-95f7-eef7fcefeb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:59.921654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8f75f518-10e5-45ce-95f7-eef7fcefeb13 None None] MFA Rules not processed for user `e538db4da67443e286408deb9663a083`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:06:59.922850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f75f518-10e5-45ce-95f7-eef7fcefeb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:06:59.931184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 754/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Tue May 10 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:06:59.940929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb398a-6c91-4a89-8cc1-faaf911163b8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:06:59.954843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb398a-6c91-4a89-8cc1-faaf911163b8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:06:59.959844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7797ab62-1659-46bc-96a8-c2c9d7509e51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:06:59.960475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ab62-1659-46bc-96a8-c2c9d7509e51 service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:06:59.960824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ab62-1659-46bc-96a8-c2c9d7509e51 service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:06:59.961086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7797ab62-1659-46bc-96a8-c2c9d7509e51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:06:59.969384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ab62-1659-46bc-96a8-c2c9d7509e51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:06:59.970943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7797ab62-1659-46bc-96a8-c2c9d7509e51 service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:06:59.980437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 767/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:07:07.728927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad26a32-3f76-417e-83ed-37dee52c0a20 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:07.729531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad26a32-3f76-417e-83ed-37dee52c0a20 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:07.729531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad26a32-3f76-417e-83ed-37dee52c0a20 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:07.730924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:07:07.736719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30077a-d73f-4d4b-b264-eaa02bd4af22 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:07.737119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30077a-d73f-4d4b-b264-eaa02bd4af22 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:07.737313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30077a-d73f-4d4b-b264-eaa02bd4af22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:07.754910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1f30077a-d73f-4d4b-b264-eaa02bd4af22 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:07:07.756143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1f30077a-d73f-4d4b-b264-eaa02bd4af22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:07.764535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:07:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:07:07.921387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad26a32-3f76-417e-83ed-37dee52c0a20 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:07:07.935592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad26a32-3f76-417e-83ed-37dee52c0a20 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:07:07.941760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a0c88-84a0-4b92-a046-03c99fdabb86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:07:07.942422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a0c88-84a0-4b92-a046-03c99fdabb86 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:07.942703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a0c88-84a0-4b92-a046-03c99fdabb86 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:07.942976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a0c88-84a0-4b92-a046-03c99fdabb86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:07.951009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a0c88-84a0-4b92-a046-03c99fdabb86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:07:07.952992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a0c88-84a0-4b92-a046-03c99fdabb86 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:07:07.962432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 756/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:07:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:07:08.849334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbbca9-00af-410e-b88c-310c12ae7f6d None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:08.849913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbbca9-00af-410e-b88c-310c12ae7f6d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:08.849913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbbca9-00af-410e-b88c-310c12ae7f6d None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:08.851394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 10 21:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:07:08.856270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713470bf-ae85-449d-84c5-c0887430a465 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:08.856679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713470bf-ae85-449d-84c5-c0887430a465 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:08.856795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713470bf-ae85-449d-84c5-c0887430a465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:08.875698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-713470bf-ae85-449d-84c5-c0887430a465 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:07:08.876875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-713470bf-ae85-449d-84c5-c0887430a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:08.884499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 10 21:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:07:09.037117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbbca9-00af-410e-b88c-310c12ae7f6d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:07:09.051887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbbca9-00af-410e-b88c-310c12ae7f6d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:07:09.057142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1e68a-8f01-4cba-9ecb-2fdd7581b961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:07:09.057800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e68a-8f01-4cba-9ecb-2fdd7581b961 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:09.058081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e68a-8f01-4cba-9ecb-2fdd7581b961 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:09.058356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1e68a-8f01-4cba-9ecb-2fdd7581b961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:09.066440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1e68a-8f01-4cba-9ecb-2fdd7581b961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:07:09.068060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1e68a-8f01-4cba-9ecb-2fdd7581b961 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:07:09.077074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 770/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:07:13.282626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58749a-dd9c-4c69-b604-5fce58521c2e None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:13.283225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58749a-dd9c-4c69-b604-5fce58521c2e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:13.283225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58749a-dd9c-4c69-b604-5fce58521c2e None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:13.284556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:07:13.289611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8cec-9363-497c-8948-a545cc2276ec None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:13.290021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8cec-9363-497c-8948-a545cc2276ec None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:13.290198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8cec-9363-497c-8948-a545cc2276ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:13.308043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c6bb8cec-9363-497c-8948-a545cc2276ec None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:07:13.309485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c6bb8cec-9363-497c-8948-a545cc2276ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:13.317174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:07:13.353096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58749a-dd9c-4c69-b604-5fce58521c2e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:07:13.354726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9f58749a-dd9c-4c69-b604-5fce58521c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:13.411939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58749a-dd9c-4c69-b604-5fce58521c2e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:07:13.415392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c03ebd-6499-40ae-9a8d-f5054f00b583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:07:13.416029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03ebd-6499-40ae-9a8d-f5054f00b583 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:13.416308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03ebd-6499-40ae-9a8d-f5054f00b583 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:13.416580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c03ebd-6499-40ae-9a8d-f5054f00b583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:13.425809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03ebd-6499-40ae-9a8d-f5054f00b583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:07:13.427245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c03ebd-6499-40ae-9a8d-f5054f00b583 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:07:13.436703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 759/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:07:15.652743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05083b-0a8c-49ab-be14-323a92c981d2 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:15.653290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05083b-0a8c-49ab-be14-323a92c981d2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:15.653290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05083b-0a8c-49ab-be14-323a92c981d2 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:15.655388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:07:15.660574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d49ba-c0e4-4fd0-89a1-9eddf7acb67e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:15.660990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d49ba-c0e4-4fd0-89a1-9eddf7acb67e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:15.661139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d49ba-c0e4-4fd0-89a1-9eddf7acb67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:15.679259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f20d49ba-c0e4-4fd0-89a1-9eddf7acb67e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:07:15.680475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f20d49ba-c0e4-4fd0-89a1-9eddf7acb67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:15.689169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:07:15.724737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05083b-0a8c-49ab-be14-323a92c981d2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:07:15.735487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05083b-0a8c-49ab-be14-323a92c981d2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:07:15.739144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c3c20-5c71-4986-81c9-f7e1d4eb38c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:07:15.739798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3c20-5c71-4986-81c9-f7e1d4eb38c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:15.740079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3c20-5c71-4986-81c9-f7e1d4eb38c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:15.740350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3c20-5c71-4986-81c9-f7e1d4eb38c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:15.750560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c3c20-5c71-4986-81c9-f7e1d4eb38c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:07:15.752120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c3c20-5c71-4986-81c9-f7e1d4eb38c8 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:07:15.761233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 773/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:07:19.474525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a596-b676-4924-b224-ba6b2a0e51bd None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:19.475106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a596-b676-4924-b224-ba6b2a0e51bd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:19.475106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800a596-b676-4924-b224-ba6b2a0e51bd None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:19.476494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:07:19.481820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81bd75-f163-48a9-ad82-241772b278e5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:19.482248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81bd75-f163-48a9-ad82-241772b278e5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:19.482956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81bd75-f163-48a9-ad82-241772b278e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:19.500634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ac81bd75-f163-48a9-ad82-241772b278e5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:07:19.501822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ac81bd75-f163-48a9-ad82-241772b278e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:19.509419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:07:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:07:19.782781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a596-b676-4924-b224-ba6b2a0e51bd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:07:19.784611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1800a596-b676-4924-b224-ba6b2a0e51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:19.840610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800a596-b676-4924-b224-ba6b2a0e51bd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:07:19.848048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0110834-e7ae-478e-81de-911d0aee2728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:07:19.848048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110834-e7ae-478e-81de-911d0aee2728 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:19.848048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110834-e7ae-478e-81de-911d0aee2728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:19.848048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0110834-e7ae-478e-81de-911d0aee2728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:19.854742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0110834-e7ae-478e-81de-911d0aee2728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:07:19.856215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0110834-e7ae-478e-81de-911d0aee2728 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:07:19.866253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 762/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:07:22.124370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b1d90-a1fc-4ed4-8fbb-67abbd86f755 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:22.124935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b1d90-a1fc-4ed4-8fbb-67abbd86f755 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:22.124935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b1d90-a1fc-4ed4-8fbb-67abbd86f755 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:22.126287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 10 21:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:07:22.131665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a40b49-4cfb-4f29-afec-a23329c3f492 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:22.132065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a40b49-4cfb-4f29-afec-a23329c3f492 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:22.132211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a40b49-4cfb-4f29-afec-a23329c3f492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:22.150395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-19a40b49-4cfb-4f29-afec-a23329c3f492 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:07:22.151599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-19a40b49-4cfb-4f29-afec-a23329c3f492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:22.159787 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 10 21:07:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:07:22.429511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b1d90-a1fc-4ed4-8fbb-67abbd86f755 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:07:22.431195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7f7b1d90-a1fc-4ed4-8fbb-67abbd86f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:07:22.444937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b1d90-a1fc-4ed4-8fbb-67abbd86f755 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:07:22.448513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d969d68-41a8-4340-af3d-5564179d1cc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:07:22.449270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969d68-41a8-4340-af3d-5564179d1cc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:07:22.449553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969d68-41a8-4340-af3d-5564179d1cc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:07:22.449854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d969d68-41a8-4340-af3d-5564179d1cc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:07:22.459805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d969d68-41a8-4340-af3d-5564179d1cc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:07:22.461225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d969d68-41a8-4340-af3d-5564179d1cc1 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:07:22.470542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 776/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:07:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:51.869172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f47cc-da9e-4c7c-9b3a-8ccd7f9ac9c0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:51.869761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f47cc-da9e-4c7c-9b3a-8ccd7f9ac9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:51.869761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6f47cc-da9e-4c7c-9b3a-8ccd7f9ac9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:51.910636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0b6f47cc-da9e-4c7c-9b3a-8ccd7f9ac9c0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:51.912251 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0b6f47cc-da9e-4c7c-9b3a-8ccd7f9ac9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:51.925607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 764/1540] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:51.938156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32391231-8119-4770-9490-81c8f1168ddc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:51.938737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32391231-8119-4770-9490-81c8f1168ddc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:51.938737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32391231-8119-4770-9490-81c8f1168ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:51.967725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-32391231-8119-4770-9490-81c8f1168ddc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:51.969238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-32391231-8119-4770-9490-81c8f1168ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:51.977882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 777/1541] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:51.982569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f47cc-da9e-4c7c-9b3a-8ccd7f9ac9c0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.000303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6f47cc-da9e-4c7c-9b3a-8ccd7f9ac9c0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.006812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.007778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.008301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.008798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.009732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:52.010259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.012272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.032589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 765/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:08:52.040982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32391231-8119-4770-9490-81c8f1168ddc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.050979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32391231-8119-4770-9490-81c8f1168ddc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.060841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.061558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.061897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.062181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.062868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.064829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.201021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 778/1543] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:52.206278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.217936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826006e0-b20a-4995-9559-69d1ebfaec0f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.288229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.289217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.289661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.290104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.290970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.293219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.388456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 766/1544] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:52.392721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.405042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e794d5-9de7-4c77-91f6-4ddcb19dffed admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.410334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.415053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.418114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.418114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.418114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.418941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.431866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 779/1545] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:52.436982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.465542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755aca0d-0460-45bb-b3ff-ab99a7291988 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.477578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045c6a8-bb1b-4cc4-a696-a41355961685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.478720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045c6a8-bb1b-4cc4-a696-a41355961685 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.479184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045c6a8-bb1b-4cc4-a696-a41355961685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.488217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045c6a8-bb1b-4cc4-a696-a41355961685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.488217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045c6a8-bb1b-4cc4-a696-a41355961685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.488217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045c6a8-bb1b-4cc4-a696-a41355961685 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.501016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 767/1546] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:52.505254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.510316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676954f-f326-4c48-ae40-da9e08c910c1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.510867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676954f-f326-4c48-ae40-da9e08c910c1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.511346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4676954f-f326-4c48-ae40-da9e08c910c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.522514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d421e-8407-4f96-aad9-232f3a376bdc admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.540354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa9f65f-bbc8-4c3a-82cf-2d2ff7a3f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.541762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f65f-bbc8-4c3a-82cf-2d2ff7a3f234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.541762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f65f-bbc8-4c3a-82cf-2d2ff7a3f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.542047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9f65f-bbc8-4c3a-82cf-2d2ff7a3f234 admin admin] PATH_INFO: `/v3/projects/bba0283b32bc4c54ae7cfcb1f984db42/users/fe93eb8c93fb4cb4bec6f7cc2c03e1eb/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.549270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4676954f-f326-4c48-ae40-da9e08c910c1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.550687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4676954f-f326-4c48-ae40-da9e08c910c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.578018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9f65f-bbc8-4c3a-82cf-2d2ff7a3f234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba0283b32bc4c54ae7cfcb1f984db42, user_id=fe93eb8c93fb4cb4bec6f7cc2c03e1eb, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.580976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa9f65f-bbc8-4c3a-82cf-2d2ff7a3f234 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.581518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 768/1547] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:08:52.582890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688921ac-ebfb-4ee9-8f1a-68ba30531a64 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.583206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688921ac-ebfb-4ee9-8f1a-68ba30531a64 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.583487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688921ac-ebfb-4ee9-8f1a-68ba30531a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.636402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-688921ac-ebfb-4ee9-8f1a-68ba30531a64 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.637832 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-688921ac-ebfb-4ee9-8f1a-68ba30531a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.652067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 769/1548] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.653645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c03df-8a99-4cdc-9449-b577892847b5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.653930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c03df-8a99-4cdc-9449-b577892847b5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.654204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c03df-8a99-4cdc-9449-b577892847b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.680661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 780/1549] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:52 2022] PUT /identity/v3/projects/bba0283b32bc4c54ae7cfcb1f984db42/users/fe93eb8c93fb4cb4bec6f7cc2c03e1eb/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:52.681752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1f1c03df-8a99-4cdc-9449-b577892847b5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.682615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957b313-2464-49ff-b07b-ffa2a86df5b8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.683097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1f1c03df-8a99-4cdc-9449-b577892847b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.683396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957b313-2464-49ff-b07b-ffa2a86df5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.683911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957b313-2464-49ff-b07b-ffa2a86df5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.703684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e957b313-2464-49ff-b07b-ffa2a86df5b8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.706073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e957b313-2464-49ff-b07b-ffa2a86df5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.751179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 770/1550] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.755146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477abee7-5964-447d-b23d-040940d81b80 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.755146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477abee7-5964-447d-b23d-040940d81b80 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.755146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477abee7-5964-447d-b23d-040940d81b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.773467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-477abee7-5964-447d-b23d-040940d81b80 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.774673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-477abee7-5964-447d-b23d-040940d81b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.778402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 781/1551] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.780916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f82260-6474-4b26-8a75-fa86e7c36549 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.781212 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f82260-6474-4b26-8a75-fa86e7c36549 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.781519 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f82260-6474-4b26-8a75-fa86e7c36549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.786306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 771/1552] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.787613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f709f-9f25-4142-a687-2bc19ed7fd30 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.787895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f709f-9f25-4142-a687-2bc19ed7fd30 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.788185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f709f-9f25-4142-a687-2bc19ed7fd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.800546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-81f82260-6474-4b26-8a75-fa86e7c36549 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.802034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-81f82260-6474-4b26-8a75-fa86e7c36549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.805856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4d5f709f-9f25-4142-a687-2bc19ed7fd30 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.806997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4d5f709f-9f25-4142-a687-2bc19ed7fd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.810034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 782/1553] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.811919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e949e11-0fcb-4da5-9346-8b514e6a789f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.812208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e949e11-0fcb-4da5-9346-8b514e6a789f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.812488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e949e11-0fcb-4da5-9346-8b514e6a789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.821754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 772/1554] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.821754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f754c6-5498-4f77-9bd2-7bac094760ec None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.821754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f754c6-5498-4f77-9bd2-7bac094760ec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.821754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f754c6-5498-4f77-9bd2-7bac094760ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.836959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0e949e11-0fcb-4da5-9346-8b514e6a789f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.838043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-12f754c6-5498-4f77-9bd2-7bac094760ec None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.838192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0e949e11-0fcb-4da5-9346-8b514e6a789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.839271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-12f754c6-5498-4f77-9bd2-7bac094760ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.847049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 783/1555] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.848017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 773/1556] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.849128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac82b-13be-4325-94a5-097b8c9a2c07 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.849425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac82b-13be-4325-94a5-097b8c9a2c07 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.849749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cac82b-13be-4325-94a5-097b8c9a2c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.855284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0277c-4678-4346-90e8-555ff0c813d6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.855284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0277c-4678-4346-90e8-555ff0c813d6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.855284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0277c-4678-4346-90e8-555ff0c813d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.872269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-35a0277c-4678-4346-90e8-555ff0c813d6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.872538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b8cac82b-13be-4325-94a5-097b8c9a2c07 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.873501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-35a0277c-4678-4346-90e8-555ff0c813d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.873771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b8cac82b-13be-4325-94a5-097b8c9a2c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.881495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 774/1557] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.881801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 784/1558] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.882556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cac82b-13be-4325-94a5-097b8c9a2c07 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.889229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf66d7-be71-4318-a385-888ddd9f9729 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.892498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf66d7-be71-4318-a385-888ddd9f9729 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.892498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf66d7-be71-4318-a385-888ddd9f9729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.892713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cac82b-13be-4325-94a5-097b8c9a2c07 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.897047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.897695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.897997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.898267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.898981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:52.899319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.900946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.908683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bdaf66d7-be71-4318-a385-888ddd9f9729 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.909897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bdaf66d7-be71-4318-a385-888ddd9f9729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.913458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 775/1559] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:08:52.914267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.920451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 785/1560] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.926717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c53d-466a-483b-b891-cdd55c6d6968 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.926717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c53d-466a-483b-b891-cdd55c6d6968 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.926717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395c53d-466a-483b-b891-cdd55c6d6968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.927091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ea1bb-5f9d-47fc-90e6-45eb6da1146b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.929571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9cba2-477c-4eed-ad4c-31cf3febe2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.930242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cba2-477c-4eed-ad4c-31cf3febe2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.930521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cba2-477c-4eed-ad4c-31cf3febe2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.930791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9cba2-477c-4eed-ad4c-31cf3febe2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.931550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9cba2-477c-4eed-ad4c-31cf3febe2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:52.931855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9cba2-477c-4eed-ad4c-31cf3febe2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:52.933445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9cba2-477c-4eed-ad4c-31cf3febe2e2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:52.941082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3395c53d-466a-483b-b891-cdd55c6d6968 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.942261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3395c53d-466a-483b-b891-cdd55c6d6968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.946098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 776/1561] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:08:52.947542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6aac-6f29-4e7d-8746-3632a8656aad None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.947827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6aac-6f29-4e7d-8746-3632a8656aad None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.948104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a6aac-6f29-4e7d-8746-3632a8656aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.950969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 786/1562] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.952548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395c53d-466a-483b-b891-cdd55c6d6968 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.969356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-611a6aac-6f29-4e7d-8746-3632a8656aad None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:52.970729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-611a6aac-6f29-4e7d-8746-3632a8656aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:52.980378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 777/1563] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:52.980378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6aac-6f29-4e7d-8746-3632a8656aad None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:52.991696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a6aac-6f29-4e7d-8746-3632a8656aad None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:52.996254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb025b-ab2f-46f7-aefa-5be516808445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:52.996930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb025b-ab2f-46f7-aefa-5be516808445 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:52.997215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb025b-ab2f-46f7-aefa-5be516808445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:52.997500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb025b-ab2f-46f7-aefa-5be516808445 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:52.998820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb025b-ab2f-46f7-aefa-5be516808445 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:52.999292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb025b-ab2f-46f7-aefa-5be516808445 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.000889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb025b-ab2f-46f7-aefa-5be516808445 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.008416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395c53d-466a-483b-b891-cdd55c6d6968 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.010039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.010684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.010970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.011280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.020852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 778/1564] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:08:53.020852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6df0-78c8-49bb-a31a-c334bbc6ad1a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.020852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6df0-78c8-49bb-a31a-c334bbc6ad1a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.020852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de6df0-78c8-49bb-a31a-c334bbc6ad1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.024908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.026345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.033213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f1de6df0-78c8-49bb-a31a-c334bbc6ad1a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:53.037222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f1de6df0-78c8-49bb-a31a-c334bbc6ad1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:53.037345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 787/1565] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:53.038142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.046261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 779/1566] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:53.046261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6df0-78c8-49bb-a31a-c334bbc6ad1a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.050972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987804ca-e06e-4b55-bbf7-14e6a9ca4750 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.055778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.056511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.056652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de6df0-78c8-49bb-a31a-c334bbc6ad1a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.056925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.057273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.058044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.060435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.062484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.063167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.063454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.063731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.064466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:53.064795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.066399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.079161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 780/1567] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:08:53.080009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.089207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92effae8-f7ea-4f57-93e7-7957fd739d64 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.096047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.096682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.096963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.097236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.097916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.098933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:08:53.098933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:08:53.098933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:08:53.100169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.194871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 788/1568] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.198507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 781/1569] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.198507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.200069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.309768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6ddc1-04dd-4516-956c-68689df563d6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.310904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d2ac1-4917-4800-b747-2ac71a264011 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.314871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.315638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.315753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.316066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.316337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.316480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.316711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.316995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.317178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:53.317489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.317718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:53.318029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.318513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING py.warnings [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 21:08:53.318513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: warnings.warn(msg) May 10 21:08:53.318513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: May 10 21:08:53.319415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.322972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.331335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 789/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:08:53.332292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.346885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 782/1571] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:08:53.346885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.350941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a815685e-6a42-416b-835b-5b36a3ed4ce8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.351560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71674c96-8673-4f89-9ef1-c0236f28801a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.356456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.356722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.358206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.358715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.358868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.359158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.359289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.359801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.359924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.360230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:08:53.360550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.361974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.362227 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.375285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 783/1572] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:08:53.381589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.386904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc3690e-37a3-486b-aac6-c15276e2fe5d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.391849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.392508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.392780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.393080 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.393820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.395729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.457496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 790/1573] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.458394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.503427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 784/1574] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/projects => generated 389 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.504332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.518639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06356c39-8f72-4680-aa2e-969b5665a0a4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.574716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbf467-45e5-4b99-8568-ae73a5e2f334 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.579895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.581093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.581221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.581470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.582072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.582212 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.582761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.583049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.583412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.584134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.584251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.585275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING py.warnings [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:08:53.585275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: warnings.warn(msg) May 10 21:08:53.585275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: May 10 21:08:53.586691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.661621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 785/1575] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/users => generated 303 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.662563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.675493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e370d86-f599-4b1b-bb33-bfb55c6310d1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.680133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.680788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.681077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.681351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.682094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.683957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.691876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 791/1576] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.691876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.695934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e29c8c-1ac6-47c5-8711-a0a81cb6d1d4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.700653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.701297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.701770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.702133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.702828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.704754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.762924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 786/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.763668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.813012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 792/1578] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:53.814366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:53.845611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0198-cc97-4bd0-a337-b233880fafce admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.881660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ab8fc-dcf5-4932-a2d5-54ef9c973550 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:53.887760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.888438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.888768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.889043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.890024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.892213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:53.906640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:53.909759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:53.909759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:53.909759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:53.909759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:53.910613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.002438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 793/1579] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:54.002438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.008840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 787/1580] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:53 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:54.009660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.017128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82166134-c3c4-4244-8306-06385b1a0dc0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.078507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.079226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.079516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.079795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.080525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.080763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a29b43f-6e9a-43de-91d2-a1cfc2174ec6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.082498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.085400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.086054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.086334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.086609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.087398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.089005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.099460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 788/1581] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.100298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.111068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a70529-cea0-403b-b6a3-addf6ad5a52c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.120262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.120262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.120262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.120262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.120670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.120670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.128840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 789/1582] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.129729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.139104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3d906-4117-4dec-84a4-7330604d7d2b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.143940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.144628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.144909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.145183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.145862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.147855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.173599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 794/1583] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:54 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:54.174488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.183922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723ad9b-86e0-45f7-ab0b-0734407809bf admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.189034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.189678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.189964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.190241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.190926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.192854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.298852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 790/1584] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:54 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:54.303271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 795/1585] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:54 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:54.303429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.303531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.316067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22386bd1-4326-4ef7-9b10-fcd77967dbb7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.316268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63307463-aac5-4f51-9e53-f4616b569c78 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.321185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.322188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.322353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.322353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.322517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.322605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.322690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.323048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.323284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.324086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.324837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.326859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.338230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 791/1586] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.339077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.350641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be7b09-f863-4344-8b50-11f2c00edd10 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.355664 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.356381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.356663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.356941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.357712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.359535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.376011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 792/1587] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.377084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.388395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04648d35-b0cf-4967-bd73-cda0ef5880a6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.393837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.394504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.394783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.395057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.395812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.397476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.409043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 793/1588] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.411429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.421307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46be65-810a-402e-93bb-ad26d1f04be8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.425902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.426540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.426821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.427092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.427830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.429454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.437025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 796/1589] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:54 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:54.438456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.446573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 794/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.446573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.453217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7413acfe-1277-4446-ac3a-bc261512d798 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.456734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f62b9-d833-4a96-bdea-3dc693a09eac admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.462228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.463751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.463751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.463751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.467543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.467543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.468656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.471479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.471764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.472046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.472793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.474538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.477153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 795/1591] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.478070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.489291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52ac95-8e19-40fb-a5df-adbeb4669f30 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.493440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 797/1592] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.494270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.495960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.498629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.498629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.498629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.499218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.501224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.505543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa201ec6-dd90-40b2-bfc0-5beef0f0c18d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.515454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.516471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.516662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.516999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] PATH_INFO: `/v3/projects/9d4f924cff8c449487d9eace4595c568/users/32bcf858bb4742eba529726ae68ea6ef/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.517150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 796/1593] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.518127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.530237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fdc3f-0443-49ef-ac14-0738c26e161f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.535750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.536886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.537173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.537451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] PATH_INFO: `/v3/projects/a3e55be674154a24a6171561d9f24175/users/e49fe4a3de4a40d9853e06f999e1ede8/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.542491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d4f924cff8c449487d9eace4595c568, user_id=32bcf858bb4742eba529726ae68ea6ef, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.548113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.555237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e55be674154a24a6171561d9f24175, user_id=e49fe4a3de4a40d9853e06f999e1ede8, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.556517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:08:54.556517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:08:54.556517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:08:54.559357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.638763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 798/1594] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:54 2022] PUT /identity/v3/projects/9d4f924cff8c449487d9eace4595c568/users/32bcf858bb4742eba529726ae68ea6ef/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:54.639864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.665615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 797/1595] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:54 2022] PUT /identity/v3/projects/a3e55be674154a24a6171561d9f24175/users/e49fe4a3de4a40d9853e06f999e1ede8/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:54.666953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.722744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fce754-e1dc-4c39-b1bf-1a2b0d3c75e9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.742847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb1d14-b0d6-4a44-a573-fc02c79d513f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.748358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.749255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.749689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.750138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.751102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.753058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.763463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 798/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.765100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.775388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4df466d-a066-49fa-8624-f47d33a1ca94 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.782132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.783021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.783331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.783603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.784339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.786073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.802678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.804107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.804525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.804886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 799/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.805040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.805896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.806029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.808393 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.817104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b335eb-e8f7-4139-bcc9-8fa15b1ecb0a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.825610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806fca9-6689-4d55-ba9d-823716f19655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.826509 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806fca9-6689-4d55-ba9d-823716f19655 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.826801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806fca9-6689-4d55-ba9d-823716f19655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.827076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806fca9-6689-4d55-ba9d-823716f19655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.827850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806fca9-6689-4d55-ba9d-823716f19655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.828894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 799/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.829788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.829896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806fca9-6689-4d55-ba9d-823716f19655 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.840824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1778a45-6a1f-43c9-a1e1-7e7c90608101 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:54.848431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:54.849414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.849759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.850107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] PATH_INFO: `/v3/projects/1a86919fcd67478c96e63b1582b6327d/users/a229c7606cac454d90c2c0c4667934fc/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.857200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 800/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:54.857200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e621-ef58-41cb-ab65-3d3c31e2141e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.857200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e621-ef58-41cb-ab65-3d3c31e2141e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.857200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a4e621-ef58-41cb-ab65-3d3c31e2141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.875604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a86919fcd67478c96e63b1582b6327d, user_id=a229c7606cac454d90c2c0c4667934fc, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:54.878503 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:54.884734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-15a4e621-ef58-41cb-ab65-3d3c31e2141e None None] MFA Rules not processed for user `32bcf858bb4742eba529726ae68ea6ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:54.886109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-15a4e621-ef58-41cb-ab65-3d3c31e2141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:54.960863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 801/1600] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:54.960863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff886-7814-4477-9da1-bad27888a16d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:54.960863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff886-7814-4477-9da1-bad27888a16d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:54.960863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff886-7814-4477-9da1-bad27888a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:54.986481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 800/1601] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:54 2022] PUT /identity/v3/projects/1a86919fcd67478c96e63b1582b6327d/users/a229c7606cac454d90c2c0c4667934fc/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:54.987262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:54.993173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c51ff886-7814-4477-9da1-bad27888a16d None None] MFA Rules not processed for user `e49fe4a3de4a40d9853e06f999e1ede8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:54.993361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c51ff886-7814-4477-9da1-bad27888a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.051817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70074ca-f8dc-46fb-81c8-e1b7e9848a49 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.057741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.058866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.059237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.059454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] PATH_INFO: `/v3/projects/8df9bf1cf45743dc8206cab528d583a1/users/da06520884ff4677af84f9e7356818ef/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.061499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 802/1602] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:55.062416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff886-7814-4477-9da1-bad27888a16d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.084570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df9bf1cf45743dc8206cab528d583a1, user_id=da06520884ff4677af84f9e7356818ef, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:55.086149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff886-7814-4477-9da1-bad27888a16d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.089261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:55.092811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.094337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.094669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.094952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] PATH_INFO: `/v3/projects/9582743483fa4fb88f4e91d3f787c945/users/62bc5605a22d408f9b4bac69a0f5f486/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.111766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9582743483fa4fb88f4e91d3f787c945, user_id=62bc5605a22d408f9b4bac69a0f5f486, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:55.114641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:55.175599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 801/1603] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:54 2022] PUT /identity/v3/projects/8df9bf1cf45743dc8206cab528d583a1/users/da06520884ff4677af84f9e7356818ef/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:55.176462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.206551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 803/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:55 2022] PUT /identity/v3/projects/9582743483fa4fb88f4e91d3f787c945/users/62bc5605a22d408f9b4bac69a0f5f486/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:55.207581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.265521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82731cf-8c10-425c-ab86-15bb1d3f06e5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.278804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debf99b-732f-450c-afbd-b2afc6b17f52 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.284132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce82b40-2ac0-4580-a013-18b91faa1010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.285200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82b40-2ac0-4580-a013-18b91faa1010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.285609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82b40-2ac0-4580-a013-18b91faa1010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.286004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce82b40-2ac0-4580-a013-18b91faa1010 admin admin] PATH_INFO: `/v3/projects/9ec69436f8724e48af59f1b87f22b9ac/users/00678cc05f4a40aa86503052b0d067f4/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.304139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82b40-2ac0-4580-a013-18b91faa1010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec69436f8724e48af59f1b87f22b9ac, user_id=00678cc05f4a40aa86503052b0d067f4, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:55.307376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce82b40-2ac0-4580-a013-18b91faa1010 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:55.338295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.339032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.343678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.343678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.343678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:55.343678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:55.362957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 802/1605] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:55.364080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.376631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 804/1606] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:55 2022] PUT /identity/v3/projects/9ec69436f8724e48af59f1b87f22b9ac/users/00678cc05f4a40aa86503052b0d067f4/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:55.377798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ee572-256f-483d-8e3a-7aa3821cd32c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.378229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ee572-256f-483d-8e3a-7aa3821cd32c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.378386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ee572-256f-483d-8e3a-7aa3821cd32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.401761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c3080-a7c2-45a3-acfa-a1805699586d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.411502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d05ee572-256f-483d-8e3a-7aa3821cd32c None None] MFA Rules not processed for user `a229c7606cac454d90c2c0c4667934fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:55.412736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d05ee572-256f-483d-8e3a-7aa3821cd32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.486964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d49ac3d-6f50-4c05-8c9d-41e917f34c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.487682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ac3d-6f50-4c05-8c9d-41e917f34c2a admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.488114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ac3d-6f50-4c05-8c9d-41e917f34c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.488432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d49ac3d-6f50-4c05-8c9d-41e917f34c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.489090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ac3d-6f50-4c05-8c9d-41e917f34c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:55.490142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 805/1607] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:55.491403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d49ac3d-6f50-4c05-8c9d-41e917f34c2a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:55.491535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884578a-e2df-4411-9e5c-8b4cf30bb60b None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.491804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884578a-e2df-4411-9e5c-8b4cf30bb60b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.492083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884578a-e2df-4411-9e5c-8b4cf30bb60b None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.493564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 806/1608] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 21:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:08:55.494564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd862ca-1e36-4158-a073-c8fe8e6ee613 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.494848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd862ca-1e36-4158-a073-c8fe8e6ee613 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.495140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd862ca-1e36-4158-a073-c8fe8e6ee613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.515642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4cd862ca-1e36-4158-a073-c8fe8e6ee613 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:55.516880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4cd862ca-1e36-4158-a073-c8fe8e6ee613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.524972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 807/1609] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:55.526178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd8ee-5122-4edd-b13a-bd8a76ae4a01 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.526374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd8ee-5122-4edd-b13a-bd8a76ae4a01 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.526617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd8ee-5122-4edd-b13a-bd8a76ae4a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.548917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b77fd8ee-5122-4edd-b13a-bd8a76ae4a01 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:55.550131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b77fd8ee-5122-4edd-b13a-bd8a76ae4a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.558459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 808/1610] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:55.559642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd8ee-5122-4edd-b13a-bd8a76ae4a01 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.570729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd8ee-5122-4edd-b13a-bd8a76ae4a01 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.575636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.578097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.578097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.578097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] PATH_INFO: `/v3/projects/bd946455713e4c36a8efadbce486ee8b/users/dc411f6a0a024e7eac561ad1b6d2a944/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.594625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd946455713e4c36a8efadbce486ee8b, user_id=dc411f6a0a024e7eac561ad1b6d2a944, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:55.598845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:55.607355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 803/1611] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:55 2022] POST /identity/v3/projects => generated 405 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:55.609141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2c249-52a7-4734-835c-ee7d61b4e0f0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.609706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2c249-52a7-4734-835c-ee7d61b4e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.610066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2c249-52a7-4734-835c-ee7d61b4e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.628571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dec2c249-52a7-4734-835c-ee7d61b4e0f0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:55.629927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dec2c249-52a7-4734-835c-ee7d61b4e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.675527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 809/1612] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:55 2022] PUT /identity/v3/projects/bd946455713e4c36a8efadbce486ee8b/users/dc411f6a0a024e7eac561ad1b6d2a944/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:55.676266 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.702330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 804/1613] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:55.702330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.702330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.702330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.728244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:55.729459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.753352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf81c5-6c50-40d4-86c5-2a6000d86d8f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.758413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.759071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.759385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.759824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.760522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:55.762529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:55.802340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 805/1614] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 21:08:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:55.803076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.805086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.867181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 810/1615] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:08:55 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:55.867181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:55.867181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:55.901845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f357c2a-66a8-4e35-b836-5d14725b57e0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.954368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dad771-086c-4d7c-8d39-38e5ad86a81f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:55.962912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.964114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.964516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.964892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:55.973573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170432e4-e189-4fad-af99-c75c9ec2d574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:55.974522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170432e4-e189-4fad-af99-c75c9ec2d574 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:55.974814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170432e4-e189-4fad-af99-c75c9ec2d574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:55.975090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170432e4-e189-4fad-af99-c75c9ec2d574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.042056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.043779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.055940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 811/1616] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:56.057230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.070363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d2b1-901e-4280-b58f-8387a376b887 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.078043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.078881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.079309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.079966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.085062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.085062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.114594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170432e4-e189-4fad-af99-c75c9ec2d574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.115226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170432e4-e189-4fad-af99-c75c9ec2d574 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.137262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 806/1617] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:56.142435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789379d9-7014-4d8c-ae65-fcc48a8b92e6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.142435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789379d9-7014-4d8c-ae65-fcc48a8b92e6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.142435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789379d9-7014-4d8c-ae65-fcc48a8b92e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.170179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 812/1618] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:56 2022] POST /identity/v3/users => generated 309 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:56.172089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.192501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c79ec7-5de5-44d1-9d6c-7e2d798ee6ae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.195449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-789379d9-7014-4d8c-ae65-fcc48a8b92e6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:56.204524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-789379d9-7014-4d8c-ae65-fcc48a8b92e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:56.204807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.204807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.204807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.204807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.219116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 807/1619] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:56.220020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789379d9-7014-4d8c-ae65-fcc48a8b92e6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.226313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.228012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.241685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 813/1620] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:56.243896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.259487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8fffc-a0ff-48ba-9751-e2a24c6c9898 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.266917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.267918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.268636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.268636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.270524 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.272933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.340711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789379d9-7014-4d8c-ae65-fcc48a8b92e6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.350979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.350979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.350979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.350979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.383366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 814/1621] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:08:56 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:08:56.384719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.408958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d420d-9e95-482c-b139-6623238c9923 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.419583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.421510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.427346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.428248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.429724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.430116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.431079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.437356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 808/1622] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:56.437356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.443026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6df1f-fd8c-463b-bd7e-bc11e1e31148 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.447586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.448439 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.448788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.449068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.453820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.460682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.466208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.474467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 809/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:56.475819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.486014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebeec75-5d16-4e14-b811-71c2e45b6782 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.490705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 815/1624] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:56.492527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.493285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.493691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.494695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.495484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.500848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.502030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.513250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678dbeed-d7a4-450a-80b1-2830beb3ecbb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.521220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 810/1625] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:56.524758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.525738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.526822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.527213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.527573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] PATH_INFO: `/v3/projects/c1ff2430c53a4bf9b97de4c5ed52a125/users/8d0c1e73494d4fc2a3c21d42942c837c/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.548463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39012c57-ed21-4e0a-95ce-4c77015fbd17 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.556968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ff2430c53a4bf9b97de4c5ed52a125, user_id=8d0c1e73494d4fc2a3c21d42942c837c, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.558442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.562314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.564009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.564376 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.564736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] PATH_INFO: `/v3/projects/286b72410ae8421382d9cb7db7dba4b3/users/fc1c6ecba5fd4dd3a26222b408c28103/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.586227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286b72410ae8421382d9cb7db7dba4b3, user_id=fc1c6ecba5fd4dd3a26222b408c28103, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.589300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.635021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 816/1626] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:56 2022] PUT /identity/v3/projects/c1ff2430c53a4bf9b97de4c5ed52a125/users/8d0c1e73494d4fc2a3c21d42942c837c/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:56.638554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.657176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 811/1627] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:56 2022] PUT /identity/v3/projects/286b72410ae8421382d9cb7db7dba4b3/users/fc1c6ecba5fd4dd3a26222b408c28103/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:56.666883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.787879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f70a8-3055-4edc-953d-20c03baa13b7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.792738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f17689-873f-4772-bec8-7ea701e7287f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.793598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.794719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.796509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.797015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.798040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.799995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.803955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.805696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.805986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.806262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.806995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.813007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.814086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 812/1628] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:08:56.818213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.844742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 817/1629] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:08:56 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:08:56.844742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:56.860093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f6effa-6507-451e-8335-3e969f23cf31 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.862912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2297ff-6bb5-4d53-8623-f3175cecc85a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:56.869026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f1d79-ec55-49f8-89ec-3fc84840e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.870026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f1d79-ec55-49f8-89ec-3fc84840e0ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.870396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f1d79-ec55-49f8-89ec-3fc84840e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.870778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f1d79-ec55-49f8-89ec-3fc84840e0ce admin admin] PATH_INFO: `/v3/projects/c1ff2430c53a4bf9b97de4c5ed52a125/users/8d0c1e73494d4fc2a3c21d42942c837c/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.873612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f1d79-ec55-49f8-89ec-3fc84840e0ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ff2430c53a4bf9b97de4c5ed52a125, user_id=8d0c1e73494d4fc2a3c21d42942c837c, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.876670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cea072-9ff2-4cd6-9a96-afb67f92974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:56.878653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea072-9ff2-4cd6-9a96-afb67f92974d admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.878880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f1d79-ec55-49f8-89ec-3fc84840e0ce admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.878999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea072-9ff2-4cd6-9a96-afb67f92974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.879274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cea072-9ff2-4cd6-9a96-afb67f92974d admin admin] PATH_INFO: `/v3/projects/286b72410ae8421382d9cb7db7dba4b3/users/fc1c6ecba5fd4dd3a26222b408c28103/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.890337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea072-9ff2-4cd6-9a96-afb67f92974d admin admin] RBAC: Authorizing `identity:create_grant(project_id=286b72410ae8421382d9cb7db7dba4b3, user_id=fc1c6ecba5fd4dd3a26222b408c28103, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:56.894611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cea072-9ff2-4cd6-9a96-afb67f92974d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:56.915194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 818/1630] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:56 2022] PUT /identity/v3/projects/c1ff2430c53a4bf9b97de4c5ed52a125/users/8d0c1e73494d4fc2a3c21d42942c837c/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:56.915194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c132f8-392e-4254-80f3-301fcdc8e501 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.915194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c132f8-392e-4254-80f3-301fcdc8e501 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.915194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c132f8-392e-4254-80f3-301fcdc8e501 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.920914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 819/1631] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 21:08:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:08:56.922576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177a9c-d3c1-4917-84cb-454692e6c377 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.923094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177a9c-d3c1-4917-84cb-454692e6c377 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.923481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4177a9c-d3c1-4917-84cb-454692e6c377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.924795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 813/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:08:56 2022] PUT /identity/v3/projects/286b72410ae8421382d9cb7db7dba4b3/users/fc1c6ecba5fd4dd3a26222b408c28103/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:56.926306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662edc02-91f8-43d0-a403-ac401d268f08 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:56.926661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662edc02-91f8-43d0-a403-ac401d268f08 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:56.927010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662edc02-91f8-43d0-a403-ac401d268f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:56.980402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-662edc02-91f8-43d0-a403-ac401d268f08 None None] MFA Rules not processed for user `8d0c1e73494d4fc2a3c21d42942c837c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:56.981684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-662edc02-91f8-43d0-a403-ac401d268f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:57.002192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a4177a9c-d3c1-4917-84cb-454692e6c377 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:57.006199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a4177a9c-d3c1-4917-84cb-454692e6c377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:57.116916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 814/1633] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:57.116916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494152-04db-402c-92f9-511371ed3970 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:57.116916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494152-04db-402c-92f9-511371ed3970 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:57.116916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494152-04db-402c-92f9-511371ed3970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:57.168826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 820/1634] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:08:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:57.172597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177a9c-d3c1-4917-84cb-454692e6c377 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:57.191591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-12494152-04db-402c-92f9-511371ed3970 None None] MFA Rules not processed for user `fc1c6ecba5fd4dd3a26222b408c28103`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:57.194389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-12494152-04db-402c-92f9-511371ed3970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:57.276553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4177a9c-d3c1-4917-84cb-454692e6c377 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:57.284053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:57.284053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:57.284053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:57.284053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:57.313766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:57.317902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:57.352411 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 821/1635] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:57.352411 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:57.372625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 815/1636] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:57.380987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca3fc8-e05c-4335-821f-184f56b273a4 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:57.386720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:57.386720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:57.386720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:57.386720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:57.412004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:57.420565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:57.470950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494152-04db-402c-92f9-511371ed3970 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:57.487981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 822/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:57.488178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494152-04db-402c-92f9-511371ed3970 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:57.495787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:57.496523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:57.496815 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:57.497091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:57.523831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:57.526102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:57.553046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 816/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:08:57.602043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:57.777071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a64996-4a19-401f-9081-ed43ef04ac47 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:57.782986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:57.789079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:57.790370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:57.790960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:57.796181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] PATH_INFO: `/v3/users/a229c7606cac454d90c2c0c4667934fc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:57.796181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a229c7606cac454d90c2c0c4667934fc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:57.796745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: WARNING py.warnings [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:08:57.796745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: warnings.warn(msg) May 10 21:08:57.796745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: May 10 21:08:57.797648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:57.800685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a76e-a046-4fd5-a78d-fe138b773f75 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:57.818018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:57.819970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:57.824443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:57.824443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] PATH_INFO: `/v3/users/32bcf858bb4742eba529726ae68ea6ef` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:57.827030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bcf858bb4742eba529726ae68ea6ef)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:57.834767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:58.085319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a229c7606cac454d90c2c0c4667934fc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.104838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a229c7606cac454d90c2c0c4667934fc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.160101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bcf858bb4742eba529726ae68ea6ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.200236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a229c7606cac454d90c2c0c4667934fc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.241304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a229c7606cac454d90c2c0c4667934fc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.242191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0a437246-d50d-4c16-bb5b-817c5e75fb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a229c7606cac454d90c2c0c4667934fc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.255412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 823/1639] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:08:57 2022] DELETE /identity/v3/users/a229c7606cac454d90c2c0c4667934fc => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:58.265951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:58.265951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:58.265951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:58.293668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:58.293851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bcf858bb4742eba529726ae68ea6ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.295549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:58.314536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bcf858bb4742eba529726ae68ea6ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.315729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bcf858bb4742eba529726ae68ea6ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.323290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a1d3e37f-3cac-451c-99e2-37049b4ef6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bcf858bb4742eba529726ae68ea6ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:08:58.338294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 817/1640] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:08:57 2022] DELETE /identity/v3/users/32bcf858bb4742eba529726ae68ea6ef => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:08:58.338294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:58.338294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:58.338294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:58.383273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:58.384601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:58.428336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 824/1641] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:58.447695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:58.449771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:58.463834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 818/1642] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:58.479637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:58.482216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:58.540547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d3771-0b38-4364-9d39-e9fc72b67f61 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:58.615879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb680c7a-79dc-4f59-afd2-a7789573f833 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:08:58.623799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9eb78-fb86-4ff9-8f37-8226b10c3311 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:58.626732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9eb78-fb86-4ff9-8f37-8226b10c3311 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:58.627220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9eb78-fb86-4ff9-8f37-8226b10c3311 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:58.627468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9eb78-fb86-4ff9-8f37-8226b10c3311 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:58.653030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9eb78-fb86-4ff9-8f37-8226b10c3311 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:58.655152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9eb78-fb86-4ff9-8f37-8226b10c3311 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:58.690934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 819/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:08:58.705829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d008eb0-3cb0-4cab-afb5-2d759566b346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:08:58.706403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d008eb0-3cb0-4cab-afb5-2d759566b346 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:58.706746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d008eb0-3cb0-4cab-afb5-2d759566b346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:58.707025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d008eb0-3cb0-4cab-afb5-2d759566b346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:58.723783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d008eb0-3cb0-4cab-afb5-2d759566b346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:08:58.726775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d008eb0-3cb0-4cab-afb5-2d759566b346 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:08:58.748857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 825/1644] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:08:59.566116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478131-1d93-42d3-8c91-f851552faab6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:59.567024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478131-1d93-42d3-8c91-f851552faab6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:59.567520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3478131-1d93-42d3-8c91-f851552faab6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:59.569566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 820/1645] 10.222.0.49 () {54 vars in 961 bytes} [Tue May 10 21:08:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:08:59.578121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:59.578712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:59.578814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:59.604143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:59.605415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:59.737911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b54bc-132a-49e2-8b89-a482f3d264b6 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:59.738252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b54bc-132a-49e2-8b89-a482f3d264b6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:59.738487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b54bc-132a-49e2-8b89-a482f3d264b6 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:59.744675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 821/1646] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 21:08:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:08:59.751301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadec1c-1faa-4651-a1df-f41f99dfe130 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:59.751301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadec1c-1faa-4651-a1df-f41f99dfe130 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:59.751301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaadec1c-1faa-4651-a1df-f41f99dfe130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:08:59.781322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 826/1647] 10.222.0.49 () {58 vars in 1058 bytes} [Tue May 10 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:08:59.828102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-aaadec1c-1faa-4651-a1df-f41f99dfe130 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:08:59.829744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-aaadec1c-1faa-4651-a1df-f41f99dfe130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:59.855332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 822/1648] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:08:59.863760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:08:59.865488 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:08:59.934612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:08:59.937402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:08:59.937402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:00.011342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] MFA Rules not processed for user `00678cc05f4a40aa86503052b0d067f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:00.013231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:00.044611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338856be-f8f0-45d0-a752-90a9f9531c06 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:00.059955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b3441-d751-4fb3-8889-f82e77546d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:00.061397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3441-d751-4fb3-8889-f82e77546d27 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:00.061686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3441-d751-4fb3-8889-f82e77546d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:00.061969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b3441-d751-4fb3-8889-f82e77546d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:00.096283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b3441-d751-4fb3-8889-f82e77546d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:00.098143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327b3441-d751-4fb3-8889-f82e77546d27 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:00.123595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 827/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:08:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:00.161203 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 823/1650] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:08:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:00.162968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:00.163312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:00.163594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:00.184486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] MFA Rules not processed for user `00678cc05f4a40aa86503052b0d067f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:00.186724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:00.202010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 828/1651] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:00.212090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:00.213724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:00.247940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70192938-e82e-4086-9ea5-cab9ae4a2a5f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:00.249656 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:00.251416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:00.274900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:00.276145 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:00.276585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:00.277306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:00.278094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db97e3-1978-4bf6-8d75-05f0e169099a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:00.288576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:00.291101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:00.291101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:00.293292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] PATH_INFO: `/v3/projects/9d4f924cff8c449487d9eace4595c568` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:00.298011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:00.298864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d4f924cff8c449487d9eace4595c568)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:00.300887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:00.303612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:00.323984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 824/1652] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:00.605019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d4f924cff8c449487d9eace4595c568', 'request_id': 'req-b2896341-8d10-402f-8ce6-199d3195c182'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:00.605019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d4f924cff8c449487d9eace4595c568', 'request_id': 'req-b2896341-8d10-402f-8ce6-199d3195c182'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:00.605019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d4f924cff8c449487d9eace4595c568', 'request_id': 'req-b2896341-8d10-402f-8ce6-199d3195c182'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:00.605019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] The token cache is being invalidate because project 9d4f924cff8c449487d9eace4595c568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:00.627501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:00.627501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:00.627501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 829/1653] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:00 2022] DELETE /identity/v3/projects/9d4f924cff8c449487d9eace4595c568 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:00.628682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:00.629198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:00.629198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:00.633410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be0849-499a-47a7-8832-f58a3fe35dce service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:00.811847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:00.814052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:00.814514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:00.815359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896341-8d10-402f-8ce6-199d3195c182 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:00.815983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] PATH_INFO: `/v3/users/8d0c1e73494d4fc2a3c21d42942c837c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:00.818607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0c1e73494d4fc2a3c21d42942c837c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:00.827215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:00.831702 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:00.833508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:00.836164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:00.836661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] PATH_INFO: `/v3/projects/1a86919fcd67478c96e63b1582b6327d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:00.842366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a86919fcd67478c96e63b1582b6327d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:00.849900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:01.157170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0c1e73494d4fc2a3c21d42942c837c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.158503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a86919fcd67478c96e63b1582b6327d', 'request_id': 'req-8ee4912c-6144-4fb4-9911-11d2b6431750'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.365175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0c1e73494d4fc2a3c21d42942c837c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.393887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0c1e73494d4fc2a3c21d42942c837c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.397598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0c1e73494d4fc2a3c21d42942c837c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.421619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bf0ed61f-c625-443f-bd40-4baedbb75113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0c1e73494d4fc2a3c21d42942c837c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.430640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 825/1654] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:00 2022] DELETE /identity/v3/users/8d0c1e73494d4fc2a3c21d42942c837c => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:01.432035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89bb09-2999-4dea-8e78-026be15d6fc8 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:01.432330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89bb09-2999-4dea-8e78-026be15d6fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:01.432611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89bb09-2999-4dea-8e78-026be15d6fc8 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:01.433972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 826/1655] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 21:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:09:01.443055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a86919fcd67478c96e63b1582b6327d', 'request_id': 'req-8ee4912c-6144-4fb4-9911-11d2b6431750'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.443917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:01.445557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:01.445892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:01.452898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a86919fcd67478c96e63b1582b6327d', 'request_id': 'req-8ee4912c-6144-4fb4-9911-11d2b6431750'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.488883 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] The token cache is being invalidate because project 1a86919fcd67478c96e63b1582b6327d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:01.488883 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.489878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.494133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 830/1656] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:00 2022] DELETE /identity/v3/projects/1a86919fcd67478c96e63b1582b6327d => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:01.508404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:01.510701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:01.520091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] MFA Rules not processed for user `c298cfd105174cd89ba5ef6eb50b1601`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:01.521389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:01.623486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 827/1657] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:09:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:01.634369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4912c-6144-4fb4-9911-11d2b6431750 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:01.656680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:01.656680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:01.676269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab74bc9-c3b7-42be-9258-7ef17ba7f64e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:01.687462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85360ab1-bc70-412f-acfa-f782fd563761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:01.689707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85360ab1-bc70-412f-acfa-f782fd563761 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:01.690000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85360ab1-bc70-412f-acfa-f782fd563761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:01.690285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85360ab1-bc70-412f-acfa-f782fd563761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:01.704818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:01.705964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:01.706826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:01.707296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] PATH_INFO: `/v3/users/fc1c6ecba5fd4dd3a26222b408c28103` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:01.709216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1c6ecba5fd4dd3a26222b408c28103)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:01.709936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85360ab1-bc70-412f-acfa-f782fd563761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:01.713503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:01.713843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85360ab1-bc70-412f-acfa-f782fd563761 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:01.738592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 828/1658] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:09:01.919013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1c6ecba5fd4dd3a26222b408c28103'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:01.948654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1c6ecba5fd4dd3a26222b408c28103'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:02.025234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1c6ecba5fd4dd3a26222b408c28103'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:02.041241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1c6ecba5fd4dd3a26222b408c28103'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:02.042006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f151d1e8-b7b6-4b84-8ba1-9ab84e1d56e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1c6ecba5fd4dd3a26222b408c28103'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:02.057140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 831/1659] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:01 2022] DELETE /identity/v3/users/fc1c6ecba5fd4dd3a26222b408c28103 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:02.113182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:02.113491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:02.113780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:02.155934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] MFA Rules not processed for user `fe93eb8c93fb4cb4bec6f7cc2c03e1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:02.157320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:02.241939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 829/1660] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:02.255979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190c62-282b-44b1-a064-067327c73e14 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:02.256277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190c62-282b-44b1-a064-067327c73e14 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:02.256617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03190c62-282b-44b1-a064-067327c73e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:02.277178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-03190c62-282b-44b1-a064-067327c73e14 None None] MFA Rules not processed for user `fe93eb8c93fb4cb4bec6f7cc2c03e1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:02.279772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-03190c62-282b-44b1-a064-067327c73e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:02.296309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 832/1661] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:02.314423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:02.321800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:02.442720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3eb48-3b3f-416a-afcf-685065f91ce0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:02.449096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff070d2-0b84-4f5e-b5f3-a00a7d5ac656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:02.449781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff070d2-0b84-4f5e-b5f3-a00a7d5ac656 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:02.450171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff070d2-0b84-4f5e-b5f3-a00a7d5ac656 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:02.450513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff070d2-0b84-4f5e-b5f3-a00a7d5ac656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:02.461768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff070d2-0b84-4f5e-b5f3-a00a7d5ac656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:02.463761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff070d2-0b84-4f5e-b5f3-a00a7d5ac656 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:02.477499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 830/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:02.914260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487deaa2-ff97-4b03-be71-411654f67403 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:02.914750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487deaa2-ff97-4b03-be71-411654f67403 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:02.915090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487deaa2-ff97-4b03-be71-411654f67403 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:02.916718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 833/1663] 10.222.0.49 () {54 vars in 960 bytes} [Tue May 10 21:09:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:09:02.924326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:02.932395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:02.932395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:02.960174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] MFA Rules not processed for user `e538db4da67443e286408deb9663a083`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:02.962969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:03.073947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 831/1664] 10.222.0.49 () {58 vars in 1057 bytes} [Tue May 10 21:09:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:03.086443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487deaa2-ff97-4b03-be71-411654f67403 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:03.106786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487deaa2-ff97-4b03-be71-411654f67403 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:03.113715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97634b30-5441-40f2-9bb3-0d0335a35973 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:03.114568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97634b30-5441-40f2-9bb3-0d0335a35973 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:03.114938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97634b30-5441-40f2-9bb3-0d0335a35973 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:03.115309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97634b30-5441-40f2-9bb3-0d0335a35973 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:03.117286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-97634b30-5441-40f2-9bb3-0d0335a35973 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:03.130746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97634b30-5441-40f2-9bb3-0d0335a35973 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:03.133041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97634b30-5441-40f2-9bb3-0d0335a35973 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:03.147296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 834/1665] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:09:03.692064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:03.693503 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:03.928710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04edb-93da-4966-b3eb-b3b0ad29ab00 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:03.946452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:03.953669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:03.954061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:03.954351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] PATH_INFO: `/v3/projects/c1ff2430c53a4bf9b97de4c5ed52a125` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:03.958522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856984c-1697-4c2e-b26e-049f6c5fe1ba None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:03.959036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856984c-1697-4c2e-b26e-049f6c5fe1ba None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:03.959142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856984c-1697-4c2e-b26e-049f6c5fe1ba None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:03.960531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 835/1666] 10.222.0.49 () {54 vars in 912 bytes} [Tue May 10 21:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:09:03.961960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ff2430c53a4bf9b97de4c5ed52a125)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:03.963024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: WARNING py.warnings [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 10 21:09:03.963024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: warnings.warn(msg) May 10 21:09:03.963024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: May 10 21:09:03.973489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:03.973773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:03.974295 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:03.975191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:04.027579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] MFA Rules not processed for user `c298cfd105174cd89ba5ef6eb50b1601`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:04.028905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:04.221724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ff2430c53a4bf9b97de4c5ed52a125', 'request_id': 'req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.226982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 836/1667] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:09:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 10 21:09:04.228015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:04.229649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:04.258416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ff2430c53a4bf9b97de4c5ed52a125', 'request_id': 'req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.258712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7668d1d-8a77-4602-bb23-25046af9c0d7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:04.298660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ff2430c53a4bf9b97de4c5ed52a125', 'request_id': 'req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.392963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] The token cache is being invalidate because project c1ff2430c53a4bf9b97de4c5ed52a125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:04.393586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.394458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.398157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 832/1668] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:03 2022] DELETE /identity/v3/projects/c1ff2430c53a4bf9b97de4c5ed52a125 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:04.399745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:04.408871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:04.427314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:04.431262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:04.431839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:04.432325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] PATH_INFO: `/v3/projects/286b72410ae8421382d9cb7db7dba4b3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:04.437292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286b72410ae8421382d9cb7db7dba4b3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:04.439395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:04.628513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7bd78-d609-4b3a-a94b-6afac0ab6ce3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:04.630391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286b72410ae8421382d9cb7db7dba4b3', 'request_id': 'req-467610fd-9f5b-4d9b-b24b-42a139670878'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.727043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286b72410ae8421382d9cb7db7dba4b3', 'request_id': 'req-467610fd-9f5b-4d9b-b24b-42a139670878'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.738713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286b72410ae8421382d9cb7db7dba4b3', 'request_id': 'req-467610fd-9f5b-4d9b-b24b-42a139670878'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.764076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] The token cache is being invalidate because project 286b72410ae8421382d9cb7db7dba4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:04.764809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.767616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-467610fd-9f5b-4d9b-b24b-42a139670878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:04.770652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c024c03-953f-4676-b8d3-65cab5cf96b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:04.771566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 837/1669] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:04 2022] DELETE /identity/v3/projects/286b72410ae8421382d9cb7db7dba4b3 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:04.772457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c024c03-953f-4676-b8d3-65cab5cf96b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:04.773996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c024c03-953f-4676-b8d3-65cab5cf96b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:04.775322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c024c03-953f-4676-b8d3-65cab5cf96b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:04.776771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304452a0-8b57-4e27-b55c-6ed1965876cd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:04.777533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304452a0-8b57-4e27-b55c-6ed1965876cd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:04.781201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304452a0-8b57-4e27-b55c-6ed1965876cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:04.784388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2c024c03-953f-4676-b8d3-65cab5cf96b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:04.812634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c024c03-953f-4676-b8d3-65cab5cf96b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:04.814351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c024c03-953f-4676-b8d3-65cab5cf96b3 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:04.829034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-304452a0-8b57-4e27-b55c-6ed1965876cd None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:04.834475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 833/1670] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:04.835182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-304452a0-8b57-4e27-b55c-6ed1965876cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:04.837523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff991ce-160f-4449-af63-7098ff0f7305 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:04.837980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff991ce-160f-4449-af63-7098ff0f7305 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:04.846205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff991ce-160f-4449-af63-7098ff0f7305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:04.905150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-aff991ce-160f-4449-af63-7098ff0f7305 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:04.908643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-aff991ce-160f-4449-af63-7098ff0f7305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:05.037513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 838/1671] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:05.045694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43f96-9acd-46e3-84ae-e3d222f9b1b7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.046157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43f96-9acd-46e3-84ae-e3d222f9b1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.046580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43f96-9acd-46e3-84ae-e3d222f9b1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.117230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e8a43f96-9acd-46e3-84ae-e3d222f9b1b7 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:05.121696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e8a43f96-9acd-46e3-84ae-e3d222f9b1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:05.132161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 834/1672] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:05.133843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca280c56-c59e-4375-af1b-fa9cfa4e0f68 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.134149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca280c56-c59e-4375-af1b-fa9cfa4e0f68 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.134433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca280c56-c59e-4375-af1b-fa9cfa4e0f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.153138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 839/1673] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:05.158152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43f96-9acd-46e3-84ae-e3d222f9b1b7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:05.177501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43f96-9acd-46e3-84ae-e3d222f9b1b7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:05.198518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:05.199398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.199934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.204741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.205651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:05.205972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:05.207671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:05.223867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ca280c56-c59e-4375-af1b-fa9cfa4e0f68 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:05.227359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ca280c56-c59e-4375-af1b-fa9cfa4e0f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:05.260652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 835/1674] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:05.266689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca280c56-c59e-4375-af1b-fa9cfa4e0f68 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:05.270569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 840/1675] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:05.271584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:05.295874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca280c56-c59e-4375-af1b-fa9cfa4e0f68 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:05.306976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:05.307742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.308031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.308226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9d6ca-d04e-4be2-ba88-248b13c412b9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:05.308522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.311706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:05.316121 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:05.341232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:05.342478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.342826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.343059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.343819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:05.344127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:05.355486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:05.396760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 841/1676] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:05.398670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:05.428997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378154b4-155a-4427-a51c-53125ce576a8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:05.443831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:05.444581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.444853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.445137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.445855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:05.447800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:05.496110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 836/1677] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:05 2022] POST /identity/v3/projects => generated 393 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:05.501213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:05.645887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 842/1678] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:05 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:05.651077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:05.711850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abb9f4-ad76-411f-9a56-a2ac4be95f39 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:05.821184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c8f75-f878-4f36-afdb-d88484e6e6bd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:05.853935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:05.855571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.855953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.856334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.857228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:05.860973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:05.877844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:05.884059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:05.884409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:05.886012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:05.887957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:05.893551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:06.004126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 843/1679] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:05 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:06.009430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:06.038748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d91014-f65b-4a24-b6f8-a5acd69ba744 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:06.042877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 837/1680] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:05 2022] POST /identity/v3/users => generated 297 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:06.047941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:06.048505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:06.049397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.049818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.050758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.051793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:06.053733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:06.068612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48470b-bfd3-49fb-a2e0-a2f51a2ec10d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:06.082783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:06.083878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.084345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.084850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.085781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:06.087811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:06.094153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 844/1681] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:06.095498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:06.112575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 838/1682] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:09:06.120289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:06.130857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484dbe6-8d40-4188-a775-3d8132a772ee admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:06.145922 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c6a33-6b0a-4b76-8cf1-4551f2359814 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:06.150576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:06.157597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.157897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.162840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.163778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:06.170463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:06.182551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:06.183954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.188241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.189001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.191083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:06.202555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:06.247670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 845/1683] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:06.251640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 839/1684] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:06.253190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:06.256985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:06.283339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b85d6d-00aa-41ad-86f4-b8dcd3618c91 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:06.286829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acf6ea-685d-4e76-afe2-d809b0f9ffaa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:06.303838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b574135-342b-4c9c-b6b0-f65444689a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:06.305614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574135-342b-4c9c-b6b0-f65444689a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.308229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574135-342b-4c9c-b6b0-f65444689a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.308695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b574135-342b-4c9c-b6b0-f65444689a15 admin admin] PATH_INFO: `/v3/projects/85f2a24831e643a5a03ac271c0fb1bcd/users/6198facae4a040a8a87eb78cf92f6d7a/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.309145 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e3ce4-cfaf-4860-838e-f25bd389bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:06.310605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e3ce4-cfaf-4860-838e-f25bd389bfb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.311016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e3ce4-cfaf-4860-838e-f25bd389bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.311408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e3ce4-cfaf-4860-838e-f25bd389bfb3 admin admin] PATH_INFO: `/v3/projects/d29f8652a5a4404587810173a720cb5e/users/83c7b8a571ce4e1b9047d2aae603a2e2/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.343982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b574135-342b-4c9c-b6b0-f65444689a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85f2a24831e643a5a03ac271c0fb1bcd, user_id=6198facae4a040a8a87eb78cf92f6d7a, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:06.350617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b574135-342b-4c9c-b6b0-f65444689a15 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:06.360111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e3ce4-cfaf-4860-838e-f25bd389bfb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29f8652a5a4404587810173a720cb5e, user_id=83c7b8a571ce4e1b9047d2aae603a2e2, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:06.363566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36e3ce4-cfaf-4860-838e-f25bd389bfb3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:06.460989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 846/1685] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:06 2022] PUT /identity/v3/projects/85f2a24831e643a5a03ac271c0fb1bcd/users/6198facae4a040a8a87eb78cf92f6d7a/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:06.473144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067b45-659a-41af-8410-e3381d1e6980 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.475294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067b45-659a-41af-8410-e3381d1e6980 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.475294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a067b45-659a-41af-8410-e3381d1e6980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.502349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 840/1686] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:06 2022] PUT /identity/v3/projects/d29f8652a5a4404587810173a720cb5e/users/83c7b8a571ce4e1b9047d2aae603a2e2/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:06.512274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3800-25d2-4d4b-b79a-5b118a87a046 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:06.512557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3800-25d2-4d4b-b79a-5b118a87a046 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:06.512836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd3800-25d2-4d4b-b79a-5b118a87a046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:06.529985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2a067b45-659a-41af-8410-e3381d1e6980 None None] MFA Rules not processed for user `6198facae4a040a8a87eb78cf92f6d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:06.532835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2a067b45-659a-41af-8410-e3381d1e6980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:06.609798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d1dd3800-25d2-4d4b-b79a-5b118a87a046 None None] MFA Rules not processed for user `83c7b8a571ce4e1b9047d2aae603a2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:06.610642 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d1dd3800-25d2-4d4b-b79a-5b118a87a046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:06.812271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 847/1687] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:06.818353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a067b45-659a-41af-8410-e3381d1e6980 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:06.902253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 841/1688] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:06.908687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3800-25d2-4d4b-b79a-5b118a87a046 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:07.041563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a067b45-659a-41af-8410-e3381d1e6980 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.059859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.060969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.061475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.061816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.062534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:07.064511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:07.124558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd3800-25d2-4d4b-b79a-5b118a87a046 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.146085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.146780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.147068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.147367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.148126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:07.150128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:07.228142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 848/1689] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:06 2022] POST /identity/v3/projects => generated 393 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:07.229324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:07.300223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 842/1690] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:06 2022] POST /identity/v3/projects => generated 387 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:07.301052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:07.459513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8586ba0d-ed99-4ef7-b173-21a801cc4cd2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.471688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.472768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.473208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.473887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.486275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:07.491174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e712c-8256-445f-aac2-b6485f93e513 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.496704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ec880-94b6-4638-a835-bc6e520dfe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.497401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec880-94b6-4638-a835-bc6e520dfe70 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.498278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec880-94b6-4638-a835-bc6e520dfe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.498608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:07.498722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec880-94b6-4638-a835-bc6e520dfe70 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.499365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ec880-94b6-4638-a835-bc6e520dfe70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:07.501387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ec880-94b6-4638-a835-bc6e520dfe70 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:07.613177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 849/1691] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:07 2022] POST /identity/v3/users => generated 303 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:07.615306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade8bf-7f33-4b17-9dd9-b98916838342 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.615607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade8bf-7f33-4b17-9dd9-b98916838342 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.615891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfade8bf-7f33-4b17-9dd9-b98916838342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.668117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 843/1692] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:07 2022] POST /identity/v3/users => generated 300 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:07.669466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:07.674583 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-bfade8bf-7f33-4b17-9dd9-b98916838342 None None] MFA Rules not processed for user `fe93eb8c93fb4cb4bec6f7cc2c03e1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:07.679778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-bfade8bf-7f33-4b17-9dd9-b98916838342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:07.750951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b8693d-6c33-447a-a3dc-03263b66e8ec admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.764265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.764990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.765275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.765555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.766307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:07.767951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:07.790573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 844/1693] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:07.790573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:07.808871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d986-3cce-4ae4-8c45-012fa0f4abbb admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.830575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.832385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.832783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.833077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.834319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:07.838110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 850/1694] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:07.839031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade8bf-7f33-4b17-9dd9-b98916838342 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:07.856943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:07.885197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 845/1695] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:07.892960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfade8bf-7f33-4b17-9dd9-b98916838342 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.893241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:07.913060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.913986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.915177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.915467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] PATH_INFO: `/v3/projects/4c6b4fc18ab94f239b508f405a04d61b/users/0ddda41405884742bdd998817e301138/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.938561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104360aa-896c-4b55-a339-dd0f1ac61079 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:07.955086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:07.958288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:07.959770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:07.967245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] PATH_INFO: `/v3/projects/226fe77763f042128f40d0ffc8aee99c/users/718be85140f84748b90aa77af2333ecf/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:07.967456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6b4fc18ab94f239b508f405a04d61b, user_id=0ddda41405884742bdd998817e301138, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:07.977115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:08.010480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226fe77763f042128f40d0ffc8aee99c, user_id=718be85140f84748b90aa77af2333ecf, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:08.019682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:08.132463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 851/1696] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:07 2022] PUT /identity/v3/projects/4c6b4fc18ab94f239b508f405a04d61b/users/0ddda41405884742bdd998817e301138/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:08.136741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:08.172131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 846/1697] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:07 2022] PUT /identity/v3/projects/226fe77763f042128f40d0ffc8aee99c/users/718be85140f84748b90aa77af2333ecf/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:08.182237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:08.346374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca3727-a9d8-45d2-bff1-0f72f8fd84aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:08.350315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4650e-f077-4cc8-a823-a1a720078c13 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:08.366762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:08.367493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.367779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.368058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.369536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:08.370241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.373255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:08.373574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.373886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.376218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:08.377956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:08.381800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:08.409063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 847/1699] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:08.411903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 852/1699] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:08.412839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:08.413160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:08.440193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2497e-0ad1-4f69-a39a-6744a22eda83 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:08.440393 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5ef459-5e04-4793-9cfe-8745815b4317 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:08.453407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e80c3-7441-4181-9427-4cbf6a97477d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:08.456630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e80c3-7441-4181-9427-4cbf6a97477d admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.456960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e80c3-7441-4181-9427-4cbf6a97477d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.458321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e80c3-7441-4181-9427-4cbf6a97477d admin admin] PATH_INFO: `/v3/projects/226fe77763f042128f40d0ffc8aee99c/users/718be85140f84748b90aa77af2333ecf/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.464271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e80c3-7441-4181-9427-4cbf6a97477d admin admin] RBAC: Authorizing `identity:create_grant(project_id=226fe77763f042128f40d0ffc8aee99c, user_id=718be85140f84748b90aa77af2333ecf, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:08.465659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe31f6-d41d-4778-95bf-12e653923086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:08.470438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe31f6-d41d-4778-95bf-12e653923086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.470736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe31f6-d41d-4778-95bf-12e653923086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.471026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe31f6-d41d-4778-95bf-12e653923086 admin admin] PATH_INFO: `/v3/projects/4c6b4fc18ab94f239b508f405a04d61b/users/0ddda41405884742bdd998817e301138/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.474409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e80c3-7441-4181-9427-4cbf6a97477d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:08.476585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe31f6-d41d-4778-95bf-12e653923086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6b4fc18ab94f239b508f405a04d61b, user_id=0ddda41405884742bdd998817e301138, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:08.488697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afe31f6-d41d-4778-95bf-12e653923086 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:08.509953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 848/1700] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:08 2022] PUT /identity/v3/projects/226fe77763f042128f40d0ffc8aee99c/users/718be85140f84748b90aa77af2333ecf/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:08.521396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 853/1701] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:08 2022] PUT /identity/v3/projects/4c6b4fc18ab94f239b508f405a04d61b/users/0ddda41405884742bdd998817e301138/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:08.522441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a4dbf-4c26-4bb1-a8ba-7c0df665a913 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.522779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a4dbf-4c26-4bb1-a8ba-7c0df665a913 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.522952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.523174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a4dbf-4c26-4bb1-a8ba-7c0df665a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.530596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.531001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.605677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a07a4dbf-4c26-4bb1-a8ba-7c0df665a913 None None] MFA Rules not processed for user `718be85140f84748b90aa77af2333ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:08.606985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a07a4dbf-4c26-4bb1-a8ba-7c0df665a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:08.610225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] MFA Rules not processed for user `0ddda41405884742bdd998817e301138`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:08.611646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:08.771640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 854/1702] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:08.778744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:08.781562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:08.866607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 849/1703] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:08.866607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.866873 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.867061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.894646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ce91f-46a0-416e-9500-4533a015d734 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:08.899459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:08.901222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.901749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.901943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.914583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:08.915879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:08.916046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:08.917974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:08.930913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 855/1704] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:09:08.932947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:08.934829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:08.950172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3f345-c842-4b81-981f-c7ecf3274116 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:08.962578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:08.963569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:08.963964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:08.964323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:08.989772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:08.991886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:09.024382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 856/1705] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:09.074157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 850/1706] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:09:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:09.092746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:09.115457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d7dcc-8cd9-41d0-b5d1-e52d429f6bc7 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:09.134430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:09.135457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:09.140173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:09.144320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:09.383095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:09.384876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:09.429708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 857/1707] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:09.460909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:09.462616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:09.532587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:09.638253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058fb9b-8028-445f-b3fc-c757cfa7111d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:09.652630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:09.653557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:09.653843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:09.661893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] PATH_INFO: `/v3/users/e49fe4a3de4a40d9853e06f999e1ede8` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:09.664798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e49fe4a3de4a40d9853e06f999e1ede8)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:09.671407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:09.731465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f387c72-7e51-4002-8da6-ca4d81d8840e service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:09.744743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:09.745803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:09.746097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:09.746607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] PATH_INFO: `/v3/users/83c7b8a571ce4e1b9047d2aae603a2e2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:09.751284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c7b8a571ce4e1b9047d2aae603a2e2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:09.754966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:10.000921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e49fe4a3de4a40d9853e06f999e1ede8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.051771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c7b8a571ce4e1b9047d2aae603a2e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.080637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c7b8a571ce4e1b9047d2aae603a2e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.122565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e49fe4a3de4a40d9853e06f999e1ede8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.161185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e49fe4a3de4a40d9853e06f999e1ede8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.164435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e49fe4a3de4a40d9853e06f999e1ede8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.186521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e49fe4a3de4a40d9853e06f999e1ede8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.205782 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 851/1708] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:09 2022] DELETE /identity/v3/users/e49fe4a3de4a40d9853e06f999e1ede8 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:10.206954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:10.216311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:10.268519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c7b8a571ce4e1b9047d2aae603a2e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.305166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c7b8a571ce4e1b9047d2aae603a2e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.307465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4918a67a-3595-4306-8031-910a85776f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c7b8a571ce4e1b9047d2aae603a2e2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:10.318751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 858/1709] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:09 2022] DELETE /identity/v3/users/83c7b8a571ce4e1b9047d2aae603a2e2 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:10.321569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02fc3b-b076-47ab-b48b-b71771a73097 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:10.321868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02fc3b-b076-47ab-b48b-b71771a73097 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:10.323432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02fc3b-b076-47ab-b48b-b71771a73097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:10.423825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5a02fc3b-b076-47ab-b48b-b71771a73097 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:10.429431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5a02fc3b-b076-47ab-b48b-b71771a73097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:10.473305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c1459-30a6-48be-b9bc-44837183db27 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:10.622042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 859/1710] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:10.626926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:10.628610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:10.628860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:10.633220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:10.634012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:10.638096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:10.638096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:10.638096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:10.706609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:10.707907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:10.734035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 860/1711] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:10.818402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:10.822489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:10.845881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 852/1712] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:09:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:09:10.986742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:10.986884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:10.988324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:10.988452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:11.208470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaec40-4229-4360-a435-b5ea15ed1c58 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:11.212762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a66854b-73a4-42e9-b79a-941d499d3e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:11.213433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66854b-73a4-42e9-b79a-941d499d3e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:11.213717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66854b-73a4-42e9-b79a-941d499d3e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:11.213996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a66854b-73a4-42e9-b79a-941d499d3e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:11.243331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66854b-73a4-42e9-b79a-941d499d3e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:11.244678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a66854b-73a4-42e9-b79a-941d499d3e29 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:11.277281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a94298-9331-47bb-8754-a2ae2a813716 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:11.282676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 853/1713] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:11.297957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:11.298640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:11.298958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:11.299247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:11.318733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:11.320302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:11.346843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 861/1714] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:14.191450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:14.192031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:14.192031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:14.236472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] MFA Rules not processed for user `da06520884ff4677af84f9e7356818ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:14.237740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:14.427543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 854/1715] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:14.692252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:14.695029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:14.735919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423ba0-eab3-4d91-9879-7671ee076174 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:14.750533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:14.753016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:14.753016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:14.753016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] PATH_INFO: `/v3/projects/d29f8652a5a4404587810173a720cb5e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:14.781046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29f8652a5a4404587810173a720cb5e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:14.814294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:14.889953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:14.892092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:15.144639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29f8652a5a4404587810173a720cb5e', 'request_id': 'req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:15.164666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75375c9-a907-4834-a027-e43c75742dcf None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:15.230406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29f8652a5a4404587810173a720cb5e', 'request_id': 'req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:15.246382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29f8652a5a4404587810173a720cb5e', 'request_id': 'req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:15.305896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] The token cache is being invalidate because project d29f8652a5a4404587810173a720cb5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:15.307350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:15.308184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:15.313399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 862/1716] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:14 2022] DELETE /identity/v3/projects/d29f8652a5a4404587810173a720cb5e => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:15.318270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:15.320358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:15.408861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:15.410035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:15.410453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:15.410847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:15.415434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:15.562675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498ca8f-6d7b-4a9a-b8b7-2b1a9ac70a6b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:15.583069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:15.587109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:15.587109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:15.587109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] PATH_INFO: `/v3/users/718be85140f84748b90aa77af2333ecf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:15.588674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:15.590292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:15.593517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] RBAC: Authorizing `identity:delete_user(user_id=718be85140f84748b90aa77af2333ecf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:15.595564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:15.610265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 855/1717] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:15.818258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:15.822618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:15.858678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e82ce6f-e9d7-4f7e-a3ff-07e8b031272b service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:15.868353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:15.869295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:15.869582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:15.869857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] PATH_INFO: `/v3/projects/a3e55be674154a24a6171561d9f24175` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:15.874560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e55be674154a24a6171561d9f24175)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:15.877476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:15.938017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718be85140f84748b90aa77af2333ecf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:15.949901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718be85140f84748b90aa77af2333ecf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.089315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718be85140f84748b90aa77af2333ecf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.109752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718be85140f84748b90aa77af2333ecf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.114917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-571b055a-591c-4309-8a97-1efe5ca2524b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718be85140f84748b90aa77af2333ecf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.152420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 863/1718] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:15 2022] DELETE /identity/v3/users/718be85140f84748b90aa77af2333ecf => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:16.163330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:16.163873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:16.165674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:16.216160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] MFA Rules not processed for user `c298cfd105174cd89ba5ef6eb50b1601`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:16.229808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:16.253866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e55be674154a24a6171561d9f24175', 'request_id': 'req-18a8255a-24eb-49e8-b9a1-86ef387b0e72'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.312502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e55be674154a24a6171561d9f24175', 'request_id': 'req-18a8255a-24eb-49e8-b9a1-86ef387b0e72'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.354554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e55be674154a24a6171561d9f24175', 'request_id': 'req-18a8255a-24eb-49e8-b9a1-86ef387b0e72'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.424363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 864/1719] 10.222.0.71 () {58 vars in 1015 bytes} [Tue May 10 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:16.436676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:16.442648 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:16.460776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] The token cache is being invalidate because project a3e55be674154a24a6171561d9f24175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:16.461333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.462183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18a8255a-24eb-49e8-b9a1-86ef387b0e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.467931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 856/1720] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:15 2022] DELETE /identity/v3/projects/a3e55be674154a24a6171561d9f24175 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:16.472135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:16.473981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:16.473981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:16.538635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:16.544379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:16.695418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c7773-c7bd-465e-9f20-6a00ebdc4cfd None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:16.709147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:16.710375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:16.710812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:16.711292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] PATH_INFO: `/v3/users/6198facae4a040a8a87eb78cf92f6d7a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:16.712773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6198facae4a040a8a87eb78cf92f6d7a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:16.715106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:16.782508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 857/1721] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:16.784752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:16.789488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:16.818516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa963-3b0b-4d2d-af8d-2eae6f36c8fe None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:16.828175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e2652-e168-41d6-80fa-ed7f71248f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:16.828852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2652-e168-41d6-80fa-ed7f71248f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:16.829844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2652-e168-41d6-80fa-ed7f71248f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:16.830132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2652-e168-41d6-80fa-ed7f71248f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:16.834023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d34e2652-e168-41d6-80fa-ed7f71248f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:16.861321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e2652-e168-41d6-80fa-ed7f71248f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:16.865475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e2652-e168-41d6-80fa-ed7f71248f72 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:16.898763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 858/1722] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:16.900730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3be9f-8f8f-4869-8e4e-58985e0c519b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:16.900730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3be9f-8f8f-4869-8e4e-58985e0c519b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:16.900900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3be9f-8f8f-4869-8e4e-58985e0c519b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:16.960650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dac3be9f-8f8f-4869-8e4e-58985e0c519b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:16.962607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dac3be9f-8f8f-4869-8e4e-58985e0c519b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:16.972003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6198facae4a040a8a87eb78cf92f6d7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:16.997060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 859/1723] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:17.001778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3be9f-8f8f-4869-8e4e-58985e0c519b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:17.004111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6198facae4a040a8a87eb78cf92f6d7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:17.030752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3be9f-8f8f-4869-8e4e-58985e0c519b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:17.043370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:17.044069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.044370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.045194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.045978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:17.048141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:17.052881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:17.089599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 860/1724] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:09:17.090898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:17.101276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6198facae4a040a8a87eb78cf92f6d7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:17.130542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6198facae4a040a8a87eb78cf92f6d7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:17.132728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2cda0d80-74df-4464-a383-91ebe0b5444e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6198facae4a040a8a87eb78cf92f6d7a'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:17.145466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d298202-6813-4124-9a16-e25f2bfa6cf9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:17.155202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:17.155890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.156177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.156457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.157168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:17.159250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:17.162717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 865/1725] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:16 2022] DELETE /identity/v3/users/6198facae4a040a8a87eb78cf92f6d7a => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:17.164695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.164988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.165269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.230878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:17.235889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:17.321444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 861/1726] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:17 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:17.322513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:17.332447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:17.411987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 866/1727] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:17.472195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:17.475034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:17.496528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5d81ca-b91e-4777-bfc2-fe5a4415d186 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:17.514171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:17.517594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.518924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.521693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.524538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:17.532426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:17.647862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 862/1728] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:17 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:17.648877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:17.685869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a437a-b650-4432-bffa-78ba1fb4ef35 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:17.693722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9c0a9d-7857-4cd5-99a6-6b3aab454668 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:17.706311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:17.707272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.707571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.707853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.708770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:17.711262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:17.738953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 863/1729] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:17.743514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:17.768521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234e6b9-7987-4c04-b613-0308d39ca6e9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:17.776447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:17.777287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.777903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.778336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.779979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:17.781827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:17.803842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90525ced-4d60-41ed-9669-44b48baccda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:17.803842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90525ced-4d60-41ed-9669-44b48baccda6 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.803842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90525ced-4d60-41ed-9669-44b48baccda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.803842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90525ced-4d60-41ed-9669-44b48baccda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.809771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 864/1730] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:17.814569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:17.828099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90525ced-4d60-41ed-9669-44b48baccda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:17.829567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90525ced-4d60-41ed-9669-44b48baccda6 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:17.843449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603356ec-91fe-43a7-a245-ae621c1873a2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:17.858934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:17.860418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:17.860855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:17.861244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] PATH_INFO: `/v3/projects/1c9c9245f72c409788167bef5210d3c1/users/8a6755d64cbb413c9ca08b8927b3f608/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:17.873917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 867/1731] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:09:17.903589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9c9245f72c409788167bef5210d3c1, user_id=8a6755d64cbb413c9ca08b8927b3f608, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:17.909558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:18.038823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 865/1732] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:17 2022] PUT /identity/v3/projects/1c9c9245f72c409788167bef5210d3c1/users/8a6755d64cbb413c9ca08b8927b3f608/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:18.050085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e82b-400b-4f19-a7d1-c19d34fd9931 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:18.052736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e82b-400b-4f19-a7d1-c19d34fd9931 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:18.054156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502e82b-400b-4f19-a7d1-c19d34fd9931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:18.113413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4502e82b-400b-4f19-a7d1-c19d34fd9931 None None] MFA Rules not processed for user `8a6755d64cbb413c9ca08b8927b3f608`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:18.114674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4502e82b-400b-4f19-a7d1-c19d34fd9931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:18.281684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 868/1733] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:18.293682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:18.295114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:18.444384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726eaf7d-4d9a-4dd5-ba9e-1789e999c918 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:18.472042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781977d1-c420-4fbd-88fc-6ac4590e543a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:18.472738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781977d1-c420-4fbd-88fc-6ac4590e543a service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:18.473030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781977d1-c420-4fbd-88fc-6ac4590e543a service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:18.473310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781977d1-c420-4fbd-88fc-6ac4590e543a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:18.497513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781977d1-c420-4fbd-88fc-6ac4590e543a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:18.505991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781977d1-c420-4fbd-88fc-6ac4590e543a service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:18.541352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 866/1734] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:18.966172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e82b-400b-4f19-a7d1-c19d34fd9931 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:19.099891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502e82b-400b-4f19-a7d1-c19d34fd9931 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:19.115248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:19.118429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:19.119113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:19.119751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] PATH_INFO: `/v3/users/8a6755d64cbb413c9ca08b8927b3f608` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:19.121287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a6755d64cbb413c9ca08b8927b3f608)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:19.126403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:19.374055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a6755d64cbb413c9ca08b8927b3f608'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:19.395413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a6755d64cbb413c9ca08b8927b3f608'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:19.495318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a6755d64cbb413c9ca08b8927b3f608'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:19.515746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a6755d64cbb413c9ca08b8927b3f608'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:19.518570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a6755d64cbb413c9ca08b8927b3f608'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:19.540004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 869/1735] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:18 2022] DELETE /identity/v3/users/8a6755d64cbb413c9ca08b8927b3f608 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:19.544370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997572e2-cdbe-41d7-93cf-127dc3723d6d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:19.544918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997572e2-cdbe-41d7-93cf-127dc3723d6d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:19.545375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997572e2-cdbe-41d7-93cf-127dc3723d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:19.586314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-997572e2-cdbe-41d7-93cf-127dc3723d6d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:19.588774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-997572e2-cdbe-41d7-93cf-127dc3723d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:19.811647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 867/1736] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:19.920875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:19.923577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:20.104154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312e08f7-9ed4-41d7-95e8-5f1c185bd6e6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:20.114868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:20.116929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:20.117429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:20.118064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:20.131103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:20.132806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:20.146208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 870/1737] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:20.444149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:20.444684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:20.445054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:20.525162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] MFA Rules not processed for user `dc411f6a0a024e7eac561ad1b6d2a944`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:20.526855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:20.597879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:20.599441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:20.633408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a847-5515-4262-a43f-e81389fe0f41 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:20.642218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 868/1738] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:20.652256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:20.656030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:20.662664 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:20.662664 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] PATH_INFO: `/v3/projects/226fe77763f042128f40d0ffc8aee99c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:20.666810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=226fe77763f042128f40d0ffc8aee99c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:20.671216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:20.678844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:20.683000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:20.930322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226fe77763f042128f40d0ffc8aee99c', 'request_id': 'req-b0385065-954f-4a46-b446-eb66b75bf927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:20.968496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bcf6f-56a6-4c22-ac65-e1a9c2e47c3a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:21.009884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226fe77763f042128f40d0ffc8aee99c', 'request_id': 'req-b0385065-954f-4a46-b446-eb66b75bf927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.019854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226fe77763f042128f40d0ffc8aee99c', 'request_id': 'req-b0385065-954f-4a46-b446-eb66b75bf927'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.064639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] The token cache is being invalidate because project 226fe77763f042128f40d0ffc8aee99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:21.065242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.067255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b0385065-954f-4a46-b446-eb66b75bf927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.078523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 871/1739] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:20 2022] DELETE /identity/v3/projects/226fe77763f042128f40d0ffc8aee99c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:21.083300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03ae1-1eed-412e-a145-0e466899a21d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:21.084249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03ae1-1eed-412e-a145-0e466899a21d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:21.085089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03ae1-1eed-412e-a145-0e466899a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:21.117450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:21.118211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:21.120770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:21.120770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:21.122152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a7d03ae1-1eed-412e-a145-0e466899a21d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:21.124918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a7d03ae1-1eed-412e-a145-0e466899a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:21.131642 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:21.240777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 872/1740] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:21.250391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d25f8-3885-4188-8d8a-410e3f0de78d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:21.255240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d25f8-3885-4188-8d8a-410e3f0de78d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:21.255240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d25f8-3885-4188-8d8a-410e3f0de78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:21.293008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a20d25f8-3885-4188-8d8a-410e3f0de78d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:21.294408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a20d25f8-3885-4188-8d8a-410e3f0de78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:21.297589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:21.299398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:21.313146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 873/1741] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:21.320304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d25f8-3885-4188-8d8a-410e3f0de78d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:21.323656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 869/1742] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:21.331300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:21.332749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d25f8-3885-4188-8d8a-410e3f0de78d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:21.333040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:21.338302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:21.339285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:21.339666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:21.340037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:21.340939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:21.343149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:21.345219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:21.364448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6fd561-bd18-41a9-af37-4729136fc67a service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:21.365072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 874/1743] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:21.369562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:21.376040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:21.376040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:21.376040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] PATH_INFO: `/v3/projects/1c9c9245f72c409788167bef5210d3c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:21.376040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9c9245f72c409788167bef5210d3c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:21.377485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:21.380415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:21.411988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59cccc1-a141-4f10-a8d0-6547c0a74298 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:21.427176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:21.427906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:21.428159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:21.428435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:21.433560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:21.433560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:21.566391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9c9245f72c409788167bef5210d3c1', 'request_id': 'req-13c22f06-4752-4ab5-b4cc-97f61f4da09e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.570199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9c9245f72c409788167bef5210d3c1', 'request_id': 'req-13c22f06-4752-4ab5-b4cc-97f61f4da09e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.574117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 875/1744] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:21 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:21.575322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:21.578983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:21.599344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9c9245f72c409788167bef5210d3c1', 'request_id': 'req-13c22f06-4752-4ab5-b4cc-97f61f4da09e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.706908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] The token cache is being invalidate because project 1c9c9245f72c409788167bef5210d3c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:21.715628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.715628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:21.715628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 870/1745] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:21 2022] DELETE /identity/v3/projects/1c9c9245f72c409788167bef5210d3c1 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:21.715628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:21.725676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:21.727389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e8263-5682-4a2d-aa85-27656ec12041 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:21.738532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:21.739766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:21.740252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:21.740697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] PATH_INFO: `/v3/projects/85f2a24831e643a5a03ac271c0fb1bcd` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:21.743815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85f2a24831e643a5a03ac271c0fb1bcd)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:21.750038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:21.984403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c22f06-4752-4ab5-b4cc-97f61f4da09e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:22.015490 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85f2a24831e643a5a03ac271c0fb1bcd', 'request_id': 'req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.110607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85f2a24831e643a5a03ac271c0fb1bcd', 'request_id': 'req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.119938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85f2a24831e643a5a03ac271c0fb1bcd', 'request_id': 'req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.136928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] The token cache is being invalidate because project 85f2a24831e643a5a03ac271c0fb1bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:22.141667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.141667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9897fbbf-30d7-4b7d-9b69-af6ca45637f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.141667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 876/1746] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:21 2022] DELETE /identity/v3/projects/85f2a24831e643a5a03ac271c0fb1bcd => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:22.145191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.145487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.145771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.172824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c022c6-cc16-4052-8e2e-a7d66d3cb0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:22.173756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c022c6-cc16-4052-8e2e-a7d66d3cb0cf admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.174114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c022c6-cc16-4052-8e2e-a7d66d3cb0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.174541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c022c6-cc16-4052-8e2e-a7d66d3cb0cf admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.175422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c022c6-cc16-4052-8e2e-a7d66d3cb0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:22.177670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c022c6-cc16-4052-8e2e-a7d66d3cb0cf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:22.187630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:22.189129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:22.220945 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 877/1747] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:22.222349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:22.223829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:22.272624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9503-582e-4a14-8e20-ee15c95a91f0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:22.299246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:22.299246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.299246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.299246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] PATH_INFO: `/v3/users/0ddda41405884742bdd998817e301138` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.299624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ddda41405884742bdd998817e301138)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:22.299624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:22.303906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 871/1748] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:21 2022] POST /identity/v3/users => generated 294 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:22.305722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.306018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.306289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.355074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:22.357008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:22.397654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 872/1749] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:22.403636 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:22.406551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:22.437598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ca729-9675-4478-846e-203bb675f650 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:22.463861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:22.465021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.465451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.465800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.467293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:22.469401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:22.498492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 873/1750] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:22.499697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:22.518013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0bda9-32bd-4280-a8dc-aed4dfbb312f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:22.543490 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ddda41405884742bdd998817e301138'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.545654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:22.546485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.546845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.547226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.549970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:22.549970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:22.549970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:22.559258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ddda41405884742bdd998817e301138'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.602375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 874/1751] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:22.603836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:22.651830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6808b-d55d-47cf-8d70-1a1e7e6cf079 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:22.681179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:22.682277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.682771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.683339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.684422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:22.687293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:22.688521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ddda41405884742bdd998817e301138'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.723626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 875/1752] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:22 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:22.725071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:22.734985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ddda41405884742bdd998817e301138'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.735834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ddda41405884742bdd998817e301138'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:22.742924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d226947-6424-4986-9352-d8ac6bda04e6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:22.762526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 878/1753] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:22 2022] DELETE /identity/v3/users/0ddda41405884742bdd998817e301138 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:22.765028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:22.770435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:22.770435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:22.770435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:22.770435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:22.770435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:22.772533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:22.776364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:22.941264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 876/1754] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:22 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:22.946052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:22.947787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:22.974072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa5b61-f9a7-4b18-a380-64270b9f148b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:23.203160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d051a32-bcde-4246-bd9c-26465f10cd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:23.204133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051a32-bcde-4246-bd9c-26465f10cd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:23.204422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051a32-bcde-4246-bd9c-26465f10cd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:23.208982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d051a32-bcde-4246-bd9c-26465f10cd36 admin admin] PATH_INFO: `/v3/projects/032d4c098e454c529f32ceaf99fc51a0/users/1d4ede607aec486a8382943369a1086d/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:23.273482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d051a32-bcde-4246-bd9c-26465f10cd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032d4c098e454c529f32ceaf99fc51a0, user_id=1d4ede607aec486a8382943369a1086d, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:23.290632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d051a32-bcde-4246-bd9c-26465f10cd36 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:23.400641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 879/1755] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:22 2022] PUT /identity/v3/projects/032d4c098e454c529f32ceaf99fc51a0/users/1d4ede607aec486a8382943369a1086d/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:23.412160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cbc81-1d1a-41da-b4d3-f365eb9f0f79 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:23.412519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cbc81-1d1a-41da-b4d3-f365eb9f0f79 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:23.412938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cbc81-1d1a-41da-b4d3-f365eb9f0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:23.511193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a71cbc81-1d1a-41da-b4d3-f365eb9f0f79 None None] MFA Rules not processed for user `1d4ede607aec486a8382943369a1086d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:23.512792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a71cbc81-1d1a-41da-b4d3-f365eb9f0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:23.628202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b60ca0f-0c8a-4c8c-bcb0-7959196c3ada admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:23.803276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 880/1756] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:23.808437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ccaa-2bba-4222-b378-51283332bce4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:23.808872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ccaa-2bba-4222-b378-51283332bce4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:23.809246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0277ccaa-2bba-4222-b378-51283332bce4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:23.812613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 881/1757] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:09:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:09:23.813461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ccaa-2bba-4222-b378-51283332bce4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:23.827738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:23.829404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:23.830257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:23.830825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:23.831776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:23.835563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:24.002007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 877/1758] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:22 2022] POST /identity/v3/users => generated 287 bytes in 1051 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:24.002007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:24.041314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5812b4f-e58d-4af8-8c25-e986d39fc99c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:24.043572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0277ccaa-2bba-4222-b378-51283332bce4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:24.051831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:24.054425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.055211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:24.055835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.056256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:24.057075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.058141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:24.059440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.059715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:24.060772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:24.067855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:24.071381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:24.099397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 878/1759] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:09:24.100921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:24.118366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeb6070-d839-4378-8060-f67edb0241c8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:24.125866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:24.127291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.128006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.129494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:24.130481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:24.134438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:24.168767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 879/1760] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:24.171617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:24.193282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 882/1761] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:23 2022] POST /identity/v3/projects => generated 385 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:24.200327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:24.208492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af552887-db07-411b-ae20-645f1484ac04 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:24.422134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78de9bc-e241-4b67-a831-1aaeadce9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:24.423188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78de9bc-e241-4b67-a831-1aaeadce9379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.429593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78de9bc-e241-4b67-a831-1aaeadce9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.430013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78de9bc-e241-4b67-a831-1aaeadce9379 admin admin] PATH_INFO: `/v3/projects/ed4734ba60714ed9b68c0b9084d36cc0/users/0d9cde61bb8b46cf9e42cc4d059bcef5/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:24.484558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78de9bc-e241-4b67-a831-1aaeadce9379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4734ba60714ed9b68c0b9084d36cc0, user_id=0d9cde61bb8b46cf9e42cc4d059bcef5, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:24.489779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78de9bc-e241-4b67-a831-1aaeadce9379 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:24.506096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe7f0e-92b6-49d3-8ec5-6f9175439646 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:24.549033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300ee883-fef9-4568-afa7-b88e692b38ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:24.549749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee883-fef9-4568-afa7-b88e692b38ab admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.550035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee883-fef9-4568-afa7-b88e692b38ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.550309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ee883-fef9-4568-afa7-b88e692b38ab admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:24.554850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ee883-fef9-4568-afa7-b88e692b38ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:24.558921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300ee883-fef9-4568-afa7-b88e692b38ab admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:24.632664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 880/1762] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:24 2022] PUT /identity/v3/projects/ed4734ba60714ed9b68c0b9084d36cc0/users/0d9cde61bb8b46cf9e42cc4d059bcef5/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:24.634529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb98d4-490d-4197-b53b-ff207c711742 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.635967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb98d4-490d-4197-b53b-ff207c711742 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.637615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb98d4-490d-4197-b53b-ff207c711742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:24.661052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 883/1763] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:24 2022] POST /identity/v3/users => generated 299 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:24.664784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.665748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.667207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:24.718912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0adb98d4-490d-4197-b53b-ff207c711742 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:24.720863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0adb98d4-490d-4197-b53b-ff207c711742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:24.760530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] MFA Rules not processed for user `62bc5605a22d408f9b4bac69a0f5f486`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:24.761930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:24.949844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 881/1764] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:24.952699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c50e9-6366-4770-a3d2-c00731340722 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:24.960070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c50e9-6366-4770-a3d2-c00731340722 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:24.960546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c50e9-6366-4770-a3d2-c00731340722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:25.055411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-de2c50e9-6366-4770-a3d2-c00731340722 None None] MFA Rules not processed for user `0d9cde61bb8b46cf9e42cc4d059bcef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:25.056735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-de2c50e9-6366-4770-a3d2-c00731340722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:25.303345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 882/1765] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:25.304309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c50e9-6366-4770-a3d2-c00731340722 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:25.337823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 884/1766] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 668 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:25.337823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:25.337823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:25.354244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0d24b-5e28-454a-b8c6-5978c17cb9bb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:25.361940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:25.362836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:25.363101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:25.363475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:25.393622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:25.395631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:25.414254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 885/1767] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:25.415649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:25.523369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f787827-8d38-4f9a-9307-409328fcf2b0 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:25.530683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c50e9-6366-4770-a3d2-c00731340722 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:25.532944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:25.550956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:25.550956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:25.550956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:25.550956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:25.550956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:25.551967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:25.551967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:25.551967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:25.551967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:25.552803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:25.555448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:25.582927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 883/1768] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:25.584078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:25.590700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:25.611363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274cb65f-5990-4144-adef-9ca22d0e3c15 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:25.618511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:25.619886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:25.620446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:25.621098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:25.640021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:25.641904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:25.657136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 886/1769] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:25 2022] POST /identity/v3/projects => generated 373 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:25.657136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:25.657367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 884/1770] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:25.666626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:25.691029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c277ec-b958-4bd5-81fb-38db17c5d4be service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:25.859147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:25.861625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:25.861625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:25.861893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:25.862665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:25.874127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:25.933828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb73d7c-dc7d-4318-840b-77cf95ac3ce0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:25.966143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:25.968862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:25.972441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:25.973050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] PATH_INFO: `/v3/projects/80a945a4f3364aa6954b76a21c0e1f99/users/39371d4ec01140f3a7a29cdf15f4a702/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:26.044022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a945a4f3364aa6954b76a21c0e1f99, user_id=39371d4ec01140f3a7a29cdf15f4a702, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:26.065522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:26.289105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 885/1771] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:25 2022] POST /identity/v3/users => generated 293 bytes in 616 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:26.289105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:26.309256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f02cfd-280e-413f-b936-b2339dcac207 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:26.321105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:26.321867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:26.322153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:26.322429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:26.323338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:26.324973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:26.350890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 886/1772] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:26.354384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:26.361998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:26.420896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440b392-97fa-4aec-b4cd-090ca905851b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:26.429372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:26.430308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:26.430594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:26.430874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] PATH_INFO: `/v3/projects/4c6b4fc18ab94f239b508f405a04d61b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:26.432589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6b4fc18ab94f239b508f405a04d61b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:26.434508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:26.771713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 887/1773] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:25 2022] PUT /identity/v3/projects/80a945a4f3364aa6954b76a21c0e1f99/users/39371d4ec01140f3a7a29cdf15f4a702/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:26.771713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:26.909458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fd70f-427d-4d31-b032-b88d664cb834 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:26.916272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a967d29e-5e93-4201-ac8d-63b000084b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:26.917318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d29e-5e93-4201-ac8d-63b000084b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:26.917729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d29e-5e93-4201-ac8d-63b000084b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:26.918007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a967d29e-5e93-4201-ac8d-63b000084b4a admin admin] PATH_INFO: `/v3/projects/3cdb4f41ca5b4bb2829a706df8698a3e/users/5b59ec942bc14555b6fdfc1e66f6fba0/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:26.947990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d29e-5e93-4201-ac8d-63b000084b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdb4f41ca5b4bb2829a706df8698a3e, user_id=5b59ec942bc14555b6fdfc1e66f6fba0, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:26.956529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a967d29e-5e93-4201-ac8d-63b000084b4a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:27.239615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 888/1774] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:26 2022] PUT /identity/v3/projects/3cdb4f41ca5b4bb2829a706df8698a3e/users/5b59ec942bc14555b6fdfc1e66f6fba0/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:27.243588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c7d8-f530-471f-9280-5802d41c09c4 None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:27.244068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6b4fc18ab94f239b508f405a04d61b', 'request_id': 'req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:27.244683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c7d8-f530-471f-9280-5802d41c09c4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:27.246766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392c7d8-f530-471f-9280-5802d41c09c4 None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:27.254079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 889/1775] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:09:27 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:09:27.256020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c7d8-f530-471f-9280-5802d41c09c4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:27.260764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6b4fc18ab94f239b508f405a04d61b', 'request_id': 'req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:27.268719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6b4fc18ab94f239b508f405a04d61b', 'request_id': 'req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:27.391272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] The token cache is being invalidate because project 4c6b4fc18ab94f239b508f405a04d61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:27.392375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:27.394721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:27.399147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 887/1776] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:26 2022] DELETE /identity/v3/projects/4c6b4fc18ab94f239b508f405a04d61b => generated 0 bytes in 1047 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:27.400460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:27.405376 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:27.501688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8392c7d8-f530-471f-9280-5802d41c09c4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:27.533665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c3284-fc34-4a4e-a32c-a8d750b730cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:27.534879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3284-fc34-4a4e-a32c-a8d750b730cf admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:27.535377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3284-fc34-4a4e-a32c-a8d750b730cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:27.535684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c3284-fc34-4a4e-a32c-a8d750b730cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:27.538845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3284-fc34-4a4e-a32c-a8d750b730cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:27.549906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c3284-fc34-4a4e-a32c-a8d750b730cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:27.573799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 890/1777] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:27.573799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034fb4-1514-400b-ae8f-f6713db32c67 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:27.573799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034fb4-1514-400b-ae8f-f6713db32c67 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:27.573799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5034fb4-1514-400b-ae8f-f6713db32c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:27.619706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c5034fb4-1514-400b-ae8f-f6713db32c67 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:27.631009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c5034fb4-1514-400b-ae8f-f6713db32c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:27.657450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f0b4c-8ffd-49cd-829e-02e6b3c7ba91 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:27.667282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030431fa-060e-44f8-9392-83ac53befba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:27.668279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030431fa-060e-44f8-9392-83ac53befba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:27.668703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030431fa-060e-44f8-9392-83ac53befba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:27.669941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030431fa-060e-44f8-9392-83ac53befba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:27.671109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030431fa-060e-44f8-9392-83ac53befba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:27.672577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030431fa-060e-44f8-9392-83ac53befba3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:27.688371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 888/1778] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:27.690368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:27.690873 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:27.691511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:27.727379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:27.728415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:27.761619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 889/1779] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:27.761619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:27.762962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:27.796554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a0f10-e0c0-422d-971f-b782ddfb76fa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:27.818116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8fc5a-1bb8-4b5e-9332-b9d4aac2b908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:27.819386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8fc5a-1bb8-4b5e-9332-b9d4aac2b908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:27.824903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8fc5a-1bb8-4b5e-9332-b9d4aac2b908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:27.824903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8fc5a-1bb8-4b5e-9332-b9d4aac2b908 admin admin] PATH_INFO: `/v3/projects/80a945a4f3364aa6954b76a21c0e1f99/users/39371d4ec01140f3a7a29cdf15f4a702/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:27.825932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8fc5a-1bb8-4b5e-9332-b9d4aac2b908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a945a4f3364aa6954b76a21c0e1f99, user_id=39371d4ec01140f3a7a29cdf15f4a702, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:27.832511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8fc5a-1bb8-4b5e-9332-b9d4aac2b908 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:27.865423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 891/1780] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:27.868103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034fb4-1514-400b-ae8f-f6713db32c67 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:27.879425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 890/1781] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:27 2022] PUT /identity/v3/projects/80a945a4f3364aa6954b76a21c0e1f99/users/39371d4ec01140f3a7a29cdf15f4a702/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:27.883734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:27.884038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:27.884322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:27.889241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5034fb4-1514-400b-ae8f-f6713db32c67 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:27.928253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:27.929836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:28.028030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5845e9-ff38-4845-b4e1-b54410abc80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:28.032763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5845e9-ff38-4845-b4e1-b54410abc80f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.032763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5845e9-ff38-4845-b4e1-b54410abc80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.032763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5845e9-ff38-4845-b4e1-b54410abc80f admin admin] PATH_INFO: `/v3/projects/3cdb4f41ca5b4bb2829a706df8698a3e/users/5b59ec942bc14555b6fdfc1e66f6fba0/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.041992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5845e9-ff38-4845-b4e1-b54410abc80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cdb4f41ca5b4bb2829a706df8698a3e, user_id=5b59ec942bc14555b6fdfc1e66f6fba0, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:28.046645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5845e9-ff38-4845-b4e1-b54410abc80f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:28.070598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 892/1782] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:27 2022] PUT /identity/v3/projects/3cdb4f41ca5b4bb2829a706df8698a3e/users/5b59ec942bc14555b6fdfc1e66f6fba0/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:28.072037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc379d-4be8-4721-943f-abf492e608e1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.074832 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc379d-4be8-4721-943f-abf492e608e1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.075295 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc379d-4be8-4721-943f-abf492e608e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.082566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 891/1783] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:28.083656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:28.085345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:28.134439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-22bc379d-4be8-4721-943f-abf492e608e1 None None] MFA Rules not processed for user `39371d4ec01140f3a7a29cdf15f4a702`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:28.135803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-22bc379d-4be8-4721-943f-abf492e608e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:28.232739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61ab5-7820-4fcf-bb95-caa037388860 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:28.282791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 893/1784] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:28.284545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.284889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.285162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.342114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] MFA Rules not processed for user `5b59ec942bc14555b6fdfc1e66f6fba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:28.343405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:28.359948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:28.361071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.361573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.362234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.382880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:28.385658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:28.406320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 892/1785] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:28.421055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:28.460643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 894/1786] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:28.461410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:28.462944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:28.531500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd0a5d-cb4d-43da-b5b6-b25c413341a5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:28.535613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:28.536942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.537184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.537459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.549210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:28.550680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:28.557248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71289489-1da8-426f-aa81-3c16b6686605 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:28.564791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:28.566106 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.567207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.568226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.568689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 895/1787] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:28.569546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:28.570903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:28.583470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:28.583874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00cbeb5-281d-49f9-810f-a94d0a744d84 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:28.584658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:28.589535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:28.595144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:28.596271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.597288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.597793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.619568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:28.619568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:28.626527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 896/1788] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:28.629525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 893/1789] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:28.630740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:28.644790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a52d0f-281a-41c6-b557-6e049e67a4d2 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:28.650513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:28.656084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.656084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.656084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.656084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:28.656771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:28.845231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 897/1790] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:28 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:28.849892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:28.862433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb17c7-1123-48c9-b0b2-235d9a53579b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:28.972982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:28.973354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:28.973653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:28.974691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:28.976428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:28.982432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:29.105824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 894/1791] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:28 2022] POST /identity/v3/users => generated 291 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:29.111495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:29.132828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cceb2e-fbd7-4085-88af-248f2faf223f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:29.156357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:29.164881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:29.164881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:29.164881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:29.164881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:29.166244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:29.199170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 898/1792] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:29.205084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:29.226958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b31e1-d5e3-4fde-a771-16896c124b4b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:29.234811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6fcd-8dd6-4501-a3cf-b6ab75d6003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:29.235555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6fcd-8dd6-4501-a3cf-b6ab75d6003e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:29.235841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6fcd-8dd6-4501-a3cf-b6ab75d6003e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:29.236114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6fcd-8dd6-4501-a3cf-b6ab75d6003e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:29.236864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac6fcd-8dd6-4501-a3cf-b6ab75d6003e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:29.238502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac6fcd-8dd6-4501-a3cf-b6ab75d6003e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:29.253530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 895/1793] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:29.254856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:29.266341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a7b6ab-3932-4a7d-bf38-abe30f74f075 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:29.271342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf64da-e7f7-4c44-8ca7-266f3cc115e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:29.272248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf64da-e7f7-4c44-8ca7-266f3cc115e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:29.272529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf64da-e7f7-4c44-8ca7-266f3cc115e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:29.272808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf64da-e7f7-4c44-8ca7-266f3cc115e9 admin admin] PATH_INFO: `/v3/projects/165e04d2b3a84748a3e9d21d77520eb9/users/34a3293dc0cb4996b9b24e5f755b19c1/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:29.290052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf64da-e7f7-4c44-8ca7-266f3cc115e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=165e04d2b3a84748a3e9d21d77520eb9, user_id=34a3293dc0cb4996b9b24e5f755b19c1, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:29.294038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf64da-e7f7-4c44-8ca7-266f3cc115e9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:29.381626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 899/1794] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:29 2022] PUT /identity/v3/projects/165e04d2b3a84748a3e9d21d77520eb9/users/34a3293dc0cb4996b9b24e5f755b19c1/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:29.394425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b166a4-6311-4c15-b3e6-4a7450e586ab None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:29.394720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b166a4-6311-4c15-b3e6-4a7450e586ab None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:29.395001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b166a4-6311-4c15-b3e6-4a7450e586ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:29.426916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90416d89-f473-424d-b42c-3db9095d3943 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:29.427293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90416d89-f473-424d-b42c-3db9095d3943 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:29.427507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90416d89-f473-424d-b42c-3db9095d3943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:29.447490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-61b166a4-6311-4c15-b3e6-4a7450e586ab None None] MFA Rules not processed for user `34a3293dc0cb4996b9b24e5f755b19c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:29.448444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-90416d89-f473-424d-b42c-3db9095d3943 None None] MFA Rules not processed for user `da06520884ff4677af84f9e7356818ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:29.448887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-61b166a4-6311-4c15-b3e6-4a7450e586ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:29.449632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-90416d89-f473-424d-b42c-3db9095d3943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:29.562581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 896/1795] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:29.572344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b166a4-6311-4c15-b3e6-4a7450e586ab None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:29.597893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 900/1796] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:29.686221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b166a4-6311-4c15-b3e6-4a7450e586ab None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:29.695460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:29.696157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:29.696442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:29.696856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:29.697574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:29.699592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:29.844294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 897/1797] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:29 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:29.845445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90416d89-f473-424d-b42c-3db9095d3943 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:29.862093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90416d89-f473-424d-b42c-3db9095d3943 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:29.957571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:29.967338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:29.970689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:29.972357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:29.972508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:29.975929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:29.989354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:30.112020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5be31-bac7-4f4f-af7d-6f391b45364b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:30.129423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:30.135735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:30.135735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:30.136622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 901/1798] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:29 2022] POST /identity/v3/users => generated 298 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:30.137493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] PATH_INFO: `/v3/users/0d9cde61bb8b46cf9e42cc4d059bcef5` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:30.139331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:30.154417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9cde61bb8b46cf9e42cc4d059bcef5)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:30.161792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:30.171460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e152a65c-6a20-48c6-9905-874c9f96f23b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:30.178856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:30.182507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:30.183149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:30.183745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:30.184691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:30.190544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:30.215733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 902/1799] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:30.217956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:30.266342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8792a-2b4c-4ba2-be93-53a52c1a5032 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:30.289438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:30.290179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:30.290540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:30.290902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] PATH_INFO: `/v3/projects/d0ade62bba474f2c94fa3332a73ac986/users/5152535b27b14159968355010c7c4418/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:30.316097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ade62bba474f2c94fa3332a73ac986, user_id=5152535b27b14159968355010c7c4418, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:30.319596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:30.445067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 903/1800] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:30 2022] PUT /identity/v3/projects/d0ade62bba474f2c94fa3332a73ac986/users/5152535b27b14159968355010c7c4418/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:30.446276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:30.509682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9cde61bb8b46cf9e42cc4d059bcef5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:30.565983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550a0a1-b76c-40c7-94f8-35b3f8eb38dc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:30.573861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:30.574949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:30.575331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:30.576343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] PATH_INFO: `/v3/users/1d4ede607aec486a8382943369a1086d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:30.577853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4ede607aec486a8382943369a1086d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:30.582623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:30.589789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9cde61bb8b46cf9e42cc4d059bcef5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:30.613282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9cde61bb8b46cf9e42cc4d059bcef5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:30.614046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9cde61bb8b46cf9e42cc4d059bcef5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:30.628480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9cde61bb8b46cf9e42cc4d059bcef5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:30.646351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 898/1801] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:29 2022] DELETE /identity/v3/users/0d9cde61bb8b46cf9e42cc4d059bcef5 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:30.647452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:30.657080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:30.757998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d69cf-b8ed-4218-87d5-6878c92e00b9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:30.764741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ea835-b046-4dee-879c-1b109faa1821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:30.765698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea835-b046-4dee-879c-1b109faa1821 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:30.766075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea835-b046-4dee-879c-1b109faa1821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:30.766425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ea835-b046-4dee-879c-1b109faa1821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:30.767594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ea835-b046-4dee-879c-1b109faa1821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:30.769269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ea835-b046-4dee-879c-1b109faa1821 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:30.800222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 899/1802] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:30.801940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7d66-af6f-4a50-bd1b-a254dacd7a8a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:30.802242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7d66-af6f-4a50-bd1b-a254dacd7a8a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:30.802522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7d66-af6f-4a50-bd1b-a254dacd7a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:30.848730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d21b7d66-af6f-4a50-bd1b-a254dacd7a8a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:30.850367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d21b7d66-af6f-4a50-bd1b-a254dacd7a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:30.859548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4ede607aec486a8382943369a1086d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:30.871543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 900/1803] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:30.871543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7d66-af6f-4a50-bd1b-a254dacd7a8a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:30.879826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7d66-af6f-4a50-bd1b-a254dacd7a8a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:30.886226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4ede607aec486a8382943369a1086d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:30.886412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:30.887368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:30.887655 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:30.887966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] PATH_INFO: `/v3/projects/d0ade62bba474f2c94fa3332a73ac986/users/5152535b27b14159968355010c7c4418/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:30.891583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ade62bba474f2c94fa3332a73ac986, user_id=5152535b27b14159968355010c7c4418, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:30.896152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:30.927221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 901/1804] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:30 2022] PUT /identity/v3/projects/d0ade62bba474f2c94fa3332a73ac986/users/5152535b27b14159968355010c7c4418/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:30.928637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:30.930483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.000988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4ede607aec486a8382943369a1086d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:31.021288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4ede607aec486a8382943369a1086d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:31.023293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cc0fff20-8fec-4e33-a6e0-7318d5b24c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4ede607aec486a8382943369a1086d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:31.027021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad82b71-143f-4975-a053-2d1f9128b8c5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:31.037087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 904/1805] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:30 2022] DELETE /identity/v3/users/1d4ede607aec486a8382943369a1086d => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:31.037087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539a73-9867-483d-ba3c-928430ea8039 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:31.037087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539a73-9867-483d-ba3c-928430ea8039 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:31.037087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539a73-9867-483d-ba3c-928430ea8039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:31.054535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33469493-17d4-4dfa-b026-5160dd65b738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:31.055394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469493-17d4-4dfa-b026-5160dd65b738 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:31.055752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469493-17d4-4dfa-b026-5160dd65b738 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:31.056144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469493-17d4-4dfa-b026-5160dd65b738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:31.058390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-33469493-17d4-4dfa-b026-5160dd65b738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.083981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b4539a73-9867-483d-ba3c-928430ea8039 None None] MFA Rules not processed for user `5152535b27b14159968355010c7c4418`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:31.085213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b4539a73-9867-483d-ba3c-928430ea8039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.149137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33469493-17d4-4dfa-b026-5160dd65b738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:31.151408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33469493-17d4-4dfa-b026-5160dd65b738 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:31.163375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 902/1806] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:31.165067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:31.165193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:31.165526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:31.183415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 905/1807] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:31.183415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:31.183415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:31.183415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:31.193633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:31.197799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.218115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] MFA Rules not processed for user `dc411f6a0a024e7eac561ad1b6d2a944`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:31.221584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.278423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 903/1808] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:31.278423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:31.278423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.311259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 906/1809] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:31.315870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:31.322184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.409817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd44d3e-5b1b-4f52-a1bd-1d7476125c56 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:31.411607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52e860-29b8-4688-8963-086a468f53b6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:31.414654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:31.415619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:31.415730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:31.415975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:31.423966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:31.425477 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:31.425477 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:31.425477 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:31.427956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:31.429476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:31.446334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 907/1810] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:31.448326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:31.452546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:31.478680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 904/1811] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:31.630781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:31.642625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d082f6-7124-4abd-a36c-2ea313f431cb service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:31.655592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:31.656260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:31.656537 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:31.656814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:31.696305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:31.817721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:31.819698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:31.848901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 908/1812] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:32.318207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:32.319905 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:32.347086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a853ff-daac-4d37-946c-58b1e1bb02f6 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:32.354103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:32.355597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:32.355883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:32.356167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] PATH_INFO: `/v3/projects/032d4c098e454c529f32ceaf99fc51a0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:32.358583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=032d4c098e454c529f32ceaf99fc51a0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:32.360592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:32.411961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:32.413591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:32.429696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ba9b61-5129-4bd2-a650-a52468631a37 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:32.434687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:32.436633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:32.437019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:32.437406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] PATH_INFO: `/v3/projects/ed4734ba60714ed9b68c0b9084d36cc0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:32.438779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4734ba60714ed9b68c0b9084d36cc0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:32.440936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:32.509954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032d4c098e454c529f32ceaf99fc51a0', 'request_id': 'req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.516534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032d4c098e454c529f32ceaf99fc51a0', 'request_id': 'req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.523487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032d4c098e454c529f32ceaf99fc51a0', 'request_id': 'req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.613060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] The token cache is being invalidate because project 032d4c098e454c529f32ceaf99fc51a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:32.613538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.616275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.618508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4734ba60714ed9b68c0b9084d36cc0', 'request_id': 'req-c11e58df-f563-4fd3-bbca-14ce419cbb3b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.619424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 905/1813] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:32 2022] DELETE /identity/v3/projects/032d4c098e454c529f32ceaf99fc51a0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:32.623634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:32.626666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:32.716512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4734ba60714ed9b68c0b9084d36cc0', 'request_id': 'req-c11e58df-f563-4fd3-bbca-14ce419cbb3b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.724725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4734ba60714ed9b68c0b9084d36cc0', 'request_id': 'req-c11e58df-f563-4fd3-bbca-14ce419cbb3b'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.725212 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2133bb6-1dd1-4293-856a-ed6bdc2eed2d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:32.742565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] The token cache is being invalidate because project ed4734ba60714ed9b68c0b9084d36cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:32.742962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.744045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:32.746218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 909/1814] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:32 2022] DELETE /identity/v3/projects/ed4734ba60714ed9b68c0b9084d36cc0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:32.750679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:32.752534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:32.889537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:32.892775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:32.893080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:32.893363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] PATH_INFO: `/v3/users/39371d4ec01140f3a7a29cdf15f4a702` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:32.897929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39371d4ec01140f3a7a29cdf15f4a702)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:32.903554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:32.929587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e58df-f563-4fd3-bbca-14ce419cbb3b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:32.947697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:32.948616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:32.948943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:32.949167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] PATH_INFO: `/v3/users/5b59ec942bc14555b6fdfc1e66f6fba0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:32.951032 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b59ec942bc14555b6fdfc1e66f6fba0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:32.955863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:33.228737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39371d4ec01140f3a7a29cdf15f4a702'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.309860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b59ec942bc14555b6fdfc1e66f6fba0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.324143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b59ec942bc14555b6fdfc1e66f6fba0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.348387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39371d4ec01140f3a7a29cdf15f4a702'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.370994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39371d4ec01140f3a7a29cdf15f4a702'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.372277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39371d4ec01140f3a7a29cdf15f4a702'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.397843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-18ffda44-336f-4d84-93c2-855ceab7ee21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39371d4ec01140f3a7a29cdf15f4a702'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.406657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 906/1815] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:32 2022] DELETE /identity/v3/users/39371d4ec01140f3a7a29cdf15f4a702 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:33.411414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:33.412062 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:33.412251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:33.438491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b59ec942bc14555b6fdfc1e66f6fba0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.453407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] MFA Rules not processed for user `62bc5605a22d408f9b4bac69a0f5f486`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:33.454879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:33.461520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b59ec942bc14555b6fdfc1e66f6fba0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.462418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8dbaf7ae-79ce-4dda-9a0e-d0b890d489ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b59ec942bc14555b6fdfc1e66f6fba0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:33.477624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 910/1816] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:32 2022] DELETE /identity/v3/users/5b59ec942bc14555b6fdfc1e66f6fba0 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:33.479042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e25786-2bca-427b-b34e-d521843ac9bf None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:33.479364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e25786-2bca-427b-b34e-d521843ac9bf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:33.479657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e25786-2bca-427b-b34e-d521843ac9bf None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:33.480943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 911/1817] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:09:33.488676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:33.488975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:33.489257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:33.527104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:33.528699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:33.581147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 907/1818] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:33.648151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 912/1819] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:09:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:33.664280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:33.665614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:33.802575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02365053-26d5-4e68-92e3-c506b40fc5d1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:33.808179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:33.808832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:33.809113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:33.809382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:33.823640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:33.825303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:33.837854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 908/1820] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:34.301988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:34.303887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:34.456480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76904d96-c860-4e39-b621-141adf2c2a4e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:34.461121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:34.463552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:34.463552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:34.463552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] PATH_INFO: `/v3/projects/3cdb4f41ca5b4bb2829a706df8698a3e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:34.463933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cdb4f41ca5b4bb2829a706df8698a3e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:34.465929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:34.498052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:34.499580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:34.513978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6fc3b-e57e-4128-aa58-77e5a124bc31 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:34.518743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:34.519633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:34.519981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:34.520265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] PATH_INFO: `/v3/projects/80a945a4f3364aa6954b76a21c0e1f99` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:34.521550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a945a4f3364aa6954b76a21c0e1f99)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:34.524271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:34.634106 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cdb4f41ca5b4bb2829a706df8698a3e', 'request_id': 'req-92934831-6e35-4999-bdc1-1706c92b1174'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.682255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a945a4f3364aa6954b76a21c0e1f99', 'request_id': 'req-635b51d1-6b86-43b2-810f-8d414727ba5f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.692201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a945a4f3364aa6954b76a21c0e1f99', 'request_id': 'req-635b51d1-6b86-43b2-810f-8d414727ba5f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.700232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a945a4f3364aa6954b76a21c0e1f99', 'request_id': 'req-635b51d1-6b86-43b2-810f-8d414727ba5f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.765702 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cdb4f41ca5b4bb2829a706df8698a3e', 'request_id': 'req-92934831-6e35-4999-bdc1-1706c92b1174'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.785794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cdb4f41ca5b4bb2829a706df8698a3e', 'request_id': 'req-92934831-6e35-4999-bdc1-1706c92b1174'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.827834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] The token cache is being invalidate because project 3cdb4f41ca5b4bb2829a706df8698a3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:34.827834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.831316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-92934831-6e35-4999-bdc1-1706c92b1174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.837456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 913/1821] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:34 2022] DELETE /identity/v3/projects/3cdb4f41ca5b4bb2829a706df8698a3e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:34.845401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5933894-45f9-4b38-8ed5-c94a90333eb8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:34.845683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5933894-45f9-4b38-8ed5-c94a90333eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:34.845968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5933894-45f9-4b38-8ed5-c94a90333eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:34.857438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] The token cache is being invalidate because project 80a945a4f3364aa6954b76a21c0e1f99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:34.858112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.859413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-635b51d1-6b86-43b2-810f-8d414727ba5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:34.861673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 909/1822] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:34 2022] DELETE /identity/v3/projects/80a945a4f3364aa6954b76a21c0e1f99 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:34.867624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da34da-3140-4439-9a32-d07ae616c6db None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:34.868221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da34da-3140-4439-9a32-d07ae616c6db None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:34.868695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da34da-3140-4439-9a32-d07ae616c6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:34.888228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d5933894-45f9-4b38-8ed5-c94a90333eb8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:34.894112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d5933894-45f9-4b38-8ed5-c94a90333eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:34.919646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a5da34da-3140-4439-9a32-d07ae616c6db None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:34.921718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a5da34da-3140-4439-9a32-d07ae616c6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:35.009009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 914/1823] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:35.010767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2601f4-663a-47fb-a070-fb3d5269898e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.012364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2601f4-663a-47fb-a070-fb3d5269898e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.013393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2601f4-663a-47fb-a070-fb3d5269898e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.021008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 910/1824] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:35.028769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b7ccf-599e-4d16-ab7c-4ef65d0f3b24 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.029143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b7ccf-599e-4d16-ab7c-4ef65d0f3b24 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.029776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b7ccf-599e-4d16-ab7c-4ef65d0f3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.049763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5e2601f4-663a-47fb-a070-fb3d5269898e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:35.052034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5e2601f4-663a-47fb-a070-fb3d5269898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:35.058138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ec7b7ccf-599e-4d16-ab7c-4ef65d0f3b24 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:35.059643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ec7b7ccf-599e-4d16-ab7c-4ef65d0f3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:35.063687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 915/1825] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:35.067624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2601f4-663a-47fb-a070-fb3d5269898e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.083814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2601f4-663a-47fb-a070-fb3d5269898e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.091797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 911/1826] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:35.095328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.095473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.099039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.099039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.099275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b7ccf-599e-4d16-ab7c-4ef65d0f3b24 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.099362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:35.099484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.101250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.111664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b7ccf-599e-4d16-ab7c-4ef65d0f3b24 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.119410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.120084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.120364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.120634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.123316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:35.123472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 916/1827] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:35.123559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.124112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.133868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.151288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 912/1828] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:35.164411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.164505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b4f3f-3d14-4665-b1c0-1ec4512f36f8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.174492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.176459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.177072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.177543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.178393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.179296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceaecf4-3c7b-4153-b116-4a04def5eb77 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.181746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.198868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.198868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.198868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.198868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.199329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.203540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.293514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 917/1829] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:35 2022] POST /identity/v3/projects => generated 355 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:35.296997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.384828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 913/1830] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:35 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:35.385719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.408974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5ac878-4b5d-495f-bc65-1508509bb68f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.500362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.501853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.502335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.502766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.503626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.507002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.509325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d13ad34-5c5d-4262-b40c-471afffe863c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.516651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.517819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.518272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.518698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.519638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.522355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.624105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 918/1831] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:35 2022] POST /identity/v3/users => generated 278 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:35.625038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 914/1832] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:35 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:35.625474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.627235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:35.632170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.642451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055432f-e6ff-4fe3-9c69-881278733b56 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.644353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bef6b-a146-45f3-86a6-d6120ef491ba admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.648230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.649326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.649520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.649919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.650352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] PATH_INFO: `/v3/users/34a3293dc0cb4996b9b24e5f755b19c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.650462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.650880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.651268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.652057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a3293dc0cb4996b9b24e5f755b19c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.652197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.654245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.655254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.666121 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 915/1833] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:35.667310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.681994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b948769-8d9d-4784-bc1c-885595b34b26 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.687137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.687807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.688102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.688404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.689137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.690729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.703387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 916/1834] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:35.704401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.715853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c41d6a4-2633-443e-9978-4c30f8d2a892 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.722625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.723356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.723641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.723923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.724669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.726271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.737846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 917/1835] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:35.738761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.753662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336a483-b12d-4e25-a764-c4dfe716f7bd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.760207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.760911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.761365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.761650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.762396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.764884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.775345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 918/1836] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:35.776008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.786774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546baf88-2942-4ff2-a7d0-3db1f7949d00 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:35.791636 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:35.792523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.792811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.793095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] PATH_INFO: `/v3/projects/9fbf7c3a6ce44ddb845eb1e5e9683e34/users/075f3cdf0d084f35bc0d2ef8c8b40808/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.815823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbf7c3a6ce44ddb845eb1e5e9683e34, user_id=075f3cdf0d084f35bc0d2ef8c8b40808, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:35.821665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:35.851004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a3293dc0cb4996b9b24e5f755b19c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:35.859747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a3293dc0cb4996b9b24e5f755b19c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:35.905839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 919/1837] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:35 2022] PUT /identity/v3/projects/9fbf7c3a6ce44ddb845eb1e5e9683e34/users/075f3cdf0d084f35bc0d2ef8c8b40808/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:35.905839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:35.961220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a3293dc0cb4996b9b24e5f755b19c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:35.975910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a3293dc0cb4996b9b24e5f755b19c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:35.976780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b720a029-c525-40c1-8f74-6c781d3c5ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a3293dc0cb4996b9b24e5f755b19c1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:35.983760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 919/1838] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:35 2022] DELETE /identity/v3/users/34a3293dc0cb4996b9b24e5f755b19c1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:35.985387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0e2b-3b32-4683-83be-978720a04254 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:35.985874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0e2b-3b32-4683-83be-978720a04254 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:35.987954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9a0e2b-3b32-4683-83be-978720a04254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:35.995878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a6733-82b5-4bb6-ab6f-922c68c2c798 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:36.017247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4e9a0e2b-3b32-4683-83be-978720a04254 None None] MFA Rules not processed for user `075f3cdf0d084f35bc0d2ef8c8b40808`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:36.018805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4e9a0e2b-3b32-4683-83be-978720a04254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:36.074317 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:36.075241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.075682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.076001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] PATH_INFO: `/v3/projects/d32d23df37de4b0db0edb55843ea765d/users/21b78fca5d0842d4879275399b9f1d84/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.092880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32d23df37de4b0db0edb55843ea765d, user_id=21b78fca5d0842d4879275399b9f1d84, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:36.095798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:36.101458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 920/1839] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:35 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:36.105732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.106180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.107361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.138381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:36.138381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:36.139230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 921/1840] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:36.140090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:36.141441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:36.154933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0dd47-7735-4d3b-a739-99b067925277 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:36.175679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9089f2d-88b5-4f22-8b10-732a5a124026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:36.178670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089f2d-88b5-4f22-8b10-732a5a124026 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.179160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089f2d-88b5-4f22-8b10-732a5a124026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.179440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089f2d-88b5-4f22-8b10-732a5a124026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.180163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9089f2d-88b5-4f22-8b10-732a5a124026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:36.182145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9089f2d-88b5-4f22-8b10-732a5a124026 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:36.235683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 920/1841] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:35 2022] PUT /identity/v3/projects/d32d23df37de4b0db0edb55843ea765d/users/21b78fca5d0842d4879275399b9f1d84/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:36.235683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:36.238199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:36.285944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 922/1842] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:36 2022] POST /identity/v3/projects => generated 355 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:36.285944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de35fa-ff48-4930-8afa-cc70842d0fb1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.285944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de35fa-ff48-4930-8afa-cc70842d0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.285944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de35fa-ff48-4930-8afa-cc70842d0fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.319159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-82de35fa-ff48-4930-8afa-cc70842d0fb1 None None] MFA Rules not processed for user `21b78fca5d0842d4879275399b9f1d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:36.320551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-82de35fa-ff48-4930-8afa-cc70842d0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:36.388572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e956b-a080-4a5b-b456-9b7725c73b84 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:36.419751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 923/1843] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:36.420845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de35fa-ff48-4930-8afa-cc70842d0fb1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:36.485976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:36.486883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.487298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.487675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.503355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de35fa-ff48-4930-8afa-cc70842d0fb1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:36.510105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:36.512466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.512466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.513512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.514553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:36.521057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:36.588888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:36.590540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:36.603308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 921/1844] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:36.604286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:36.605735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:36.648846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 924/1845] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:36 2022] POST /identity/v3/users => generated 284 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:36.649865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:36.670422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b1016-44c4-4cd0-9205-793a92833322 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:36.683294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:36.683973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.685161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.685161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.686448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:36.696666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:36.700727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58e375-dba5-47ef-956a-c6a38bf1f4c4 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:36.706310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:36.706986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.707305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.707584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.717811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 925/1846] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:09:36.722847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:36.746966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf74a79-2942-4546-be8f-d7760142dec9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:36.747067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:36.751400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:36.753919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:36.755188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:36.755468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:36.755755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] PATH_INFO: `/v3/projects/c8047913145f42f998caecbada03f68b/users/61c19e7db5b74421bd372b9962bc5e1a/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:36.772563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 922/1847] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:36.790201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8047913145f42f998caecbada03f68b, user_id=61c19e7db5b74421bd372b9962bc5e1a, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:36.792885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:36.928653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 926/1848] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:36 2022] PUT /identity/v3/projects/c8047913145f42f998caecbada03f68b/users/61c19e7db5b74421bd372b9962bc5e1a/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:36.929948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:36.947800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dce229-0335-45d9-a90b-80c685076188 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:37.059053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541162e4-1a67-4a97-8e62-97318aae72d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:37.060420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541162e4-1a67-4a97-8e62-97318aae72d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:37.061296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541162e4-1a67-4a97-8e62-97318aae72d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:37.061678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541162e4-1a67-4a97-8e62-97318aae72d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:37.064206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541162e4-1a67-4a97-8e62-97318aae72d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:37.065146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541162e4-1a67-4a97-8e62-97318aae72d8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:37.079102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 923/1849] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:09:37.080551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:37.093676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344d2c0-e9ad-4644-9ef1-05c96fb8e884 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:37.101037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:37.102231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:37.102547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:37.103471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] PATH_INFO: `/v3/projects/c8047913145f42f998caecbada03f68b/users/61c19e7db5b74421bd372b9962bc5e1a/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:37.106017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8047913145f42f998caecbada03f68b, user_id=61c19e7db5b74421bd372b9962bc5e1a, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:37.109736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:37.134950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 927/1850] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:37 2022] PUT /identity/v3/projects/c8047913145f42f998caecbada03f68b/users/61c19e7db5b74421bd372b9962bc5e1a/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:37.148709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:37.149126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:37.149504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:37.230530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] MFA Rules not processed for user `61c19e7db5b74421bd372b9962bc5e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:37.230530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:37.380474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 924/1851] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:37 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:37.393755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:37.396074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:37.452638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:37.454147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:37.491389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61b5f5-40cc-4b10-b41c-62f3369fc95f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:37.506710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:37.508132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:37.508595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:37.509011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:37.523615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:37.562879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:37.573300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7165b-87b4-4384-9cdc-7cc794207754 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:37.586567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:37.586567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:37.586872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:37.588847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] PATH_INFO: `/v3/projects/165e04d2b3a84748a3e9d21d77520eb9` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:37.589859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=165e04d2b3a84748a3e9d21d77520eb9)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:37.594501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:37.596936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 928/1852] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:37.775447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '165e04d2b3a84748a3e9d21d77520eb9', 'request_id': 'req-db416b98-f9f7-4006-b80a-015d23200888'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:37.784765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '165e04d2b3a84748a3e9d21d77520eb9', 'request_id': 'req-db416b98-f9f7-4006-b80a-015d23200888'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:37.793890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '165e04d2b3a84748a3e9d21d77520eb9', 'request_id': 'req-db416b98-f9f7-4006-b80a-015d23200888'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:37.894317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:37.903033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831edaad-3a6e-4c15-a569-534795251d5d service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:37.949021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] The token cache is being invalidate because project 165e04d2b3a84748a3e9d21d77520eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:37.949504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:37.951487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:37.958406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 925/1853] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:37 2022] DELETE /identity/v3/projects/165e04d2b3a84748a3e9d21d77520eb9 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:37.960277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:37.962218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:37.962751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:37.963758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:37.964191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:37.964697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:37.967075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:38.042706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db416b98-f9f7-4006-b80a-015d23200888 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:38.049088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:38.056453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:38.056453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:38.056453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] PATH_INFO: `/v3/users/5152535b27b14159968355010c7c4418` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:38.056453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=5152535b27b14159968355010c7c4418)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:38.056453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:38.057819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:38.059487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:38.072614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 929/1854] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:37 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:09:38.293760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5152535b27b14159968355010c7c4418'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:38.391906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5152535b27b14159968355010c7c4418'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:38.407434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5152535b27b14159968355010c7c4418'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:38.408105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5152535b27b14159968355010c7c4418'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:38.433233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-22e4241d-46e7-41b6-b543-2bf131166caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5152535b27b14159968355010c7c4418'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:38.452206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 926/1855] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:37 2022] DELETE /identity/v3/users/5152535b27b14159968355010c7c4418 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:39.355730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:39.381560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d946898-b6fc-4e61-9eef-ffe439cfa9da service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:39.508128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:39.509582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:39.510126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:39.510869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] PATH_INFO: `/v3/projects/d0ade62bba474f2c94fa3332a73ac986` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:39.514146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ade62bba474f2c94fa3332a73ac986)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:39.518720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:39.693093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ade62bba474f2c94fa3332a73ac986', 'request_id': 'req-d0bce9df-a86b-4692-b896-d6819d26b3a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:39.772414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ade62bba474f2c94fa3332a73ac986', 'request_id': 'req-d0bce9df-a86b-4692-b896-d6819d26b3a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:39.799430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ade62bba474f2c94fa3332a73ac986', 'request_id': 'req-d0bce9df-a86b-4692-b896-d6819d26b3a6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:39.817838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] The token cache is being invalidate because project d0ade62bba474f2c94fa3332a73ac986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:39.818794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:39.828990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0bce9df-a86b-4692-b896-d6819d26b3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:39.828990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 930/1856] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:39 2022] DELETE /identity/v3/projects/d0ade62bba474f2c94fa3332a73ac986 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:39.834284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16085e2-a25b-4738-91a4-7135160ac191 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:39.834741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16085e2-a25b-4738-91a4-7135160ac191 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:39.834828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16085e2-a25b-4738-91a4-7135160ac191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:39.860708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f16085e2-a25b-4738-91a4-7135160ac191 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:39.862162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f16085e2-a25b-4738-91a4-7135160ac191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:39.962936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 927/1857] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:39.971825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad743-2455-4f4d-b1f5-a0b4f672ca58 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:39.972642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad743-2455-4f4d-b1f5-a0b4f672ca58 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:39.973017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad743-2455-4f4d-b1f5-a0b4f672ca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.014493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a77ad743-2455-4f4d-b1f5-a0b4f672ca58 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:40.020601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a77ad743-2455-4f4d-b1f5-a0b4f672ca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:40.038978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 931/1858] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:40.043725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16085e2-a25b-4738-91a4-7135160ac191 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.063638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16085e2-a25b-4738-91a4-7135160ac191 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:40.068374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:40.069052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.069369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.069696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.070482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:40.070883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:40.072544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:40.087044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 928/1859] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:40.092014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad743-2455-4f4d-b1f5-a0b4f672ca58 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.103280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad743-2455-4f4d-b1f5-a0b4f672ca58 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:40.111438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:40.112549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.113006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.113359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.114161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:40.128797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:40.296154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 932/1860] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:40 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:40.296881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.311013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d50df2-c681-4462-b26d-f9406835c29e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:40.393710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:40.394720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.395251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.395699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.397457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:40.398692 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:40.499535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 929/1861] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:40 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:40.504601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.515744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf5355-0282-4c36-985e-327cba562fe4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:40.520316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:40.520981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.521270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.521551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.522320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:40.523987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:40.534705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 933/1862] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:40.538669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.548776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f8a-02b0-4710-b8a6-69651d8de911 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:40.553261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ea1e5-b711-4306-8d8d-337483d79902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:40.553926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea1e5-b711-4306-8d8d-337483d79902 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.554206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea1e5-b711-4306-8d8d-337483d79902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.554480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea1e5-b711-4306-8d8d-337483d79902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.555236 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ea1e5-b711-4306-8d8d-337483d79902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:40.556848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ea1e5-b711-4306-8d8d-337483d79902 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:40.567582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 930/1863] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:40.571770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.582932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5f2964-1718-446e-8a8a-7e2fecc876f9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:40.587793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:40.588848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.589129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.589404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] PATH_INFO: `/v3/projects/5ab6bd100493450c95e8499ca8bd3b3e/users/b19b689a42f24f33a26ecff0adc74dda/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.604590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ab6bd100493450c95e8499ca8bd3b3e, user_id=b19b689a42f24f33a26ecff0adc74dda, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:40.607539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:40.670379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 934/1864] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:40 2022] PUT /identity/v3/projects/5ab6bd100493450c95e8499ca8bd3b3e/users/b19b689a42f24f33a26ecff0adc74dda/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:40.681858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9603c3-df88-457e-9f6f-2652034e0daa None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.682129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9603c3-df88-457e-9f6f-2652034e0daa None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.682405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9603c3-df88-457e-9f6f-2652034e0daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.709527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6b9603c3-df88-457e-9f6f-2652034e0daa None None] MFA Rules not processed for user `b19b689a42f24f33a26ecff0adc74dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:40.710744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6b9603c3-df88-457e-9f6f-2652034e0daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:40.778295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 931/1865] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:40.783761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.862762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bdb6b5-0280-4cec-a1c8-e5fc0a9474b6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:40.867463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:40.868135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:40.868419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:40.868700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:40.869397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:40.871470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:40.962430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 935/1866] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:40 2022] POST /identity/v3/projects => generated 381 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:40.963677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9603c3-df88-457e-9f6f-2652034e0daa None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:40.975230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9603c3-df88-457e-9f6f-2652034e0daa None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:41.030903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:41.031606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.032028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.032311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.033045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:41.034920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:41.146232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 932/1867] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:40 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:41.150176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:41.162053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3396d3-4b23-4e6f-872e-c92d010bda76 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:41.166604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:41.167327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.167611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.167888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.168605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:41.171017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:41.182451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 936/1868] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:41.186998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:41.197634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7417eb9-cad1-4b55-92ae-bb3bff069a23 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:41.202102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:41.202979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.203301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.203576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] PATH_INFO: `/v3/projects/05a4347ad461464e88db10a476d35c56/users/5397b969ada44badb531890dac4d3e27/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.218646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a4347ad461464e88db10a476d35c56, user_id=5397b969ada44badb531890dac4d3e27, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:41.221331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:41.329255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 933/1869] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:41 2022] PUT /identity/v3/projects/05a4347ad461464e88db10a476d35c56/users/5397b969ada44badb531890dac4d3e27/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:41.333042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:41.343397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419a4c5-3db5-4d68-a05f-e66671377d1d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:41.398860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52059d49-2e79-41c5-9d55-5bf523b9023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:41.399552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059d49-2e79-41c5-9d55-5bf523b9023b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.399840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059d49-2e79-41c5-9d55-5bf523b9023b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.400116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52059d49-2e79-41c5-9d55-5bf523b9023b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.400840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52059d49-2e79-41c5-9d55-5bf523b9023b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:41.402434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52059d49-2e79-41c5-9d55-5bf523b9023b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:41.412513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 937/1870] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:41.416633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:41.427400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e43858-dd41-45d5-b5c8-57247bf968e6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:41.432001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:41.432878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.433161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.433440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] PATH_INFO: `/v3/projects/05a4347ad461464e88db10a476d35c56/users/5397b969ada44badb531890dac4d3e27/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.435448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a4347ad461464e88db10a476d35c56, user_id=5397b969ada44badb531890dac4d3e27, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:41.438336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:41.448291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 934/1871] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:41 2022] PUT /identity/v3/projects/05a4347ad461464e88db10a476d35c56/users/5397b969ada44badb531890dac4d3e27/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:41.463646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c75761-9b15-4f13-9411-e5ca599b4932 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.463942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c75761-9b15-4f13-9411-e5ca599b4932 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.464227 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c75761-9b15-4f13-9411-e5ca599b4932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.491063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-79c75761-9b15-4f13-9411-e5ca599b4932 None None] MFA Rules not processed for user `5397b969ada44badb531890dac4d3e27`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:41.492293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-79c75761-9b15-4f13-9411-e5ca599b4932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:41.558367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 938/1872] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:41.571528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:41.573236 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:41.632515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380c91e-ddc3-4f78-904f-5c88762a45c7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:41.636297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:41.636949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.637230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.637505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.647868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:41.649307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:41.661602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 935/1873] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:41.864253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c75761-9b15-4f13-9411-e5ca599b4932 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:41.874459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c75761-9b15-4f13-9411-e5ca599b4932 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:41.878148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1709562-6d2b-4cea-87a8-c972280f334d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:41.878789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1709562-6d2b-4cea-87a8-c972280f334d service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:41.879072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1709562-6d2b-4cea-87a8-c972280f334d service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:41.879380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1709562-6d2b-4cea-87a8-c972280f334d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:41.938395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1709562-6d2b-4cea-87a8-c972280f334d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:41.940151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1709562-6d2b-4cea-87a8-c972280f334d service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:41.949641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 939/1874] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:09:42.426779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:42.493780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afc4f16-dddf-4b00-a2ab-9653976f9e40 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:42.498490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:42.499473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:42.499840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:42.500085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] PATH_INFO: `/v3/users/b19b689a42f24f33a26ecff0adc74dda` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:42.501281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19b689a42f24f33a26ecff0adc74dda)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:42.503215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:42.793196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19b689a42f24f33a26ecff0adc74dda'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:42.854927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19b689a42f24f33a26ecff0adc74dda'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:42.868183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19b689a42f24f33a26ecff0adc74dda'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:42.872150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19b689a42f24f33a26ecff0adc74dda'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:42.876153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19b689a42f24f33a26ecff0adc74dda'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:42.882193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 936/1875] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:42 2022] DELETE /identity/v3/users/b19b689a42f24f33a26ecff0adc74dda => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:42.886767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:42.887821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:42.888780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:42.932039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:42.932039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:42.992964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 940/1876] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:43.006394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:43.008065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:43.074909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227391b3-b6b6-4850-b4b6-4b2423fca437 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:43.080005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:43.082312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:43.082312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:43.082312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:43.091268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:43.092886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:43.103269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 937/1877] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:43.867534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:43.869408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:43.936280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76124a84-ead0-40d3-b4b0-077e7d1754ac None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:43.951906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:43.953065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:43.953658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:43.954153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] PATH_INFO: `/v3/projects/5ab6bd100493450c95e8499ca8bd3b3e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:43.958116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ab6bd100493450c95e8499ca8bd3b3e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:43.960535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:44.142907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ab6bd100493450c95e8499ca8bd3b3e', 'request_id': 'req-ff2743b6-45d4-4410-8702-11c99fe35f22'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.283808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ab6bd100493450c95e8499ca8bd3b3e', 'request_id': 'req-ff2743b6-45d4-4410-8702-11c99fe35f22'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.291638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ab6bd100493450c95e8499ca8bd3b3e', 'request_id': 'req-ff2743b6-45d4-4410-8702-11c99fe35f22'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.319324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] The token cache is being invalidate because project 5ab6bd100493450c95e8499ca8bd3b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:44.319624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.321724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.329384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 941/1878] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:43 2022] DELETE /identity/v3/projects/5ab6bd100493450c95e8499ca8bd3b3e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:44.333644 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:44.364932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21daf040-4ff4-4033-896f-04167d738482 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:44.454458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:44.455497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:44.455880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:44.456276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] PATH_INFO: `/v3/users/5397b969ada44badb531890dac4d3e27` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:44.458240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5397b969ada44badb531890dac4d3e27)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:44.461148 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:44.674942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5397b969ada44badb531890dac4d3e27'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.786335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5397b969ada44badb531890dac4d3e27'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.805104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5397b969ada44badb531890dac4d3e27'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.806025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5397b969ada44badb531890dac4d3e27'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.817298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8b8fd3a3-c997-485e-b55c-89029b852549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5397b969ada44badb531890dac4d3e27'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:44.828399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 938/1879] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:44 2022] DELETE /identity/v3/users/5397b969ada44badb531890dac4d3e27 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:45.427599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:45.429884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:45.458007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2743b6-45d4-4410-8702-11c99fe35f22 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:45.524981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:45.525674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:45.525963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:45.526246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] PATH_INFO: `/v3/projects/05a4347ad461464e88db10a476d35c56` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:45.527596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a4347ad461464e88db10a476d35c56)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:45.530277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:45.667051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a4347ad461464e88db10a476d35c56', 'request_id': 'req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:45.770224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a4347ad461464e88db10a476d35c56', 'request_id': 'req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:45.783162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a4347ad461464e88db10a476d35c56', 'request_id': 'req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:45.801829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] The token cache is being invalidate because project 05a4347ad461464e88db10a476d35c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:45.803000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:45.803925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-922d0c8d-5fa4-4ef7-a1f9-da3d47d37b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:45.821448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626e60-495b-4700-b260-2b3927982912 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:45.821952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626e60-495b-4700-b260-2b3927982912 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:45.822070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3626e60-495b-4700-b260-2b3927982912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:45.839958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 942/1880] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:45 2022] DELETE /identity/v3/projects/05a4347ad461464e88db10a476d35c56 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:45.854144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a3626e60-495b-4700-b260-2b3927982912 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:45.855397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a3626e60-495b-4700-b260-2b3927982912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:45.931825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 939/1881] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:45.935704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cd2c2-aecd-45b7-98f2-db85274ba301 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:45.936323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cd2c2-aecd-45b7-98f2-db85274ba301 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:45.936670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cd2c2-aecd-45b7-98f2-db85274ba301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:45.956619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f41cd2c2-aecd-45b7-98f2-db85274ba301 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:45.957848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f41cd2c2-aecd-45b7-98f2-db85274ba301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:45.967242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 943/1882] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:45.970820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626e60-495b-4700-b260-2b3927982912 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:45.980400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3626e60-495b-4700-b260-2b3927982912 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:45.985969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:45.986628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:45.986919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:45.987235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:45.987983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:45.988295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:45.989931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:46.001912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 940/1883] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:46.006359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cd2c2-aecd-45b7-98f2-db85274ba301 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:46.016142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cd2c2-aecd-45b7-98f2-db85274ba301 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:46.021101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:46.021752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.022030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.022302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.023021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:46.025074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:46.176538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 944/1884] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:46 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:46.181005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:46.191804 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5322a-2e05-40af-ac35-07d2e1281521 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:46.263677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:46.263677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.263677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.263677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.264041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:46.266320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:46.357223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 941/1885] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:46 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:46.361588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:46.372642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15004036-4cbd-4840-96fb-b6b5312d4894 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:46.377838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:46.378512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.378794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.379091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.381264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:46.381452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:46.395997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 945/1886] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:09:46.398198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:46.409158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0283c5-b8f2-4180-bed3-db76a48e738c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:46.414456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfa4bc-6a86-4b2e-b274-ff8066a9c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:46.415474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa4bc-6a86-4b2e-b274-ff8066a9c60e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.415754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa4bc-6a86-4b2e-b274-ff8066a9c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.416153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfa4bc-6a86-4b2e-b274-ff8066a9c60e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.416896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfa4bc-6a86-4b2e-b274-ff8066a9c60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:46.418678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfa4bc-6a86-4b2e-b274-ff8066a9c60e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:46.433889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 942/1887] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:46.437231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:46.448234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950942d-4b88-4788-b1c5-bd2330dbb674 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:46.453750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:46.454745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.455094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.455477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] PATH_INFO: `/v3/projects/7f2856affb4b4bd4bf04d2ec68fd3451/users/4e03e5777c2b4cf589a7641a0f480610/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.471159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2856affb4b4bd4bf04d2ec68fd3451, user_id=4e03e5777c2b4cf589a7641a0f480610, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:46.474122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:46.560623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 946/1888] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:46 2022] PUT /identity/v3/projects/7f2856affb4b4bd4bf04d2ec68fd3451/users/4e03e5777c2b4cf589a7641a0f480610/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:46.571938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b25b-32b1-4e54-954a-83df1747df5b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.581700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b25b-32b1-4e54-954a-83df1747df5b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.581700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd1b25b-32b1-4e54-954a-83df1747df5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.619717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5bd1b25b-32b1-4e54-954a-83df1747df5b None None] MFA Rules not processed for user `4e03e5777c2b4cf589a7641a0f480610`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:46.620953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5bd1b25b-32b1-4e54-954a-83df1747df5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:46.688667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 943/1889] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:46.693092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:46.756530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24fdc4-d23c-4f70-9eea-7024e9db7aae admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:46.761476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:46.762206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.763070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.763495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.764244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:46.766217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:46.867660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 947/1890] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:46 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:46.871746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b25b-32b1-4e54-954a-83df1747df5b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:46.888980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd1b25b-32b1-4e54-954a-83df1747df5b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:46.960604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:46.961357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:46.961909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:46.962337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:46.963244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:46.965161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.113380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 944/1891] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:46 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:47.117370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.136148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7775193-0d7a-4863-88c0-787dac6bd1d2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.136148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.136148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.136148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.136485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.136485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.137484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.152865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.154660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 948/1892] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:47.163838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07a9ba-3333-434d-9294-9e11349d42fd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.168601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a88391-ce13-4b82-86e0-72a93c6575eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.170363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88391-ce13-4b82-86e0-72a93c6575eb admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.170652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88391-ce13-4b82-86e0-72a93c6575eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.170927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88391-ce13-4b82-86e0-72a93c6575eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.171949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a88391-ce13-4b82-86e0-72a93c6575eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.173541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a88391-ce13-4b82-86e0-72a93c6575eb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.194956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 945/1893] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:47.196340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.206768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a8d33-332e-400f-ab52-39c237ebfe2d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.216298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.216298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.216298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.216298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] PATH_INFO: `/v3/projects/7724d38dc2da4ab7b3f76465e8f91e7a/users/038a7b39ae654ce38584459e1469a697/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.233097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7724d38dc2da4ab7b3f76465e8f91e7a, user_id=038a7b39ae654ce38584459e1469a697, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.235738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.343801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 949/1894] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:47 2022] PUT /identity/v3/projects/7724d38dc2da4ab7b3f76465e8f91e7a/users/038a7b39ae654ce38584459e1469a697/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:47.352200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbcb2e-65e5-41dd-84cf-b083686a228c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.352492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbcb2e-65e5-41dd-84cf-b083686a228c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.352770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbcb2e-65e5-41dd-84cf-b083686a228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.383070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-84cbcb2e-65e5-41dd-84cf-b083686a228c None None] MFA Rules not processed for user `038a7b39ae654ce38584459e1469a697`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:47.384457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-84cbcb2e-65e5-41dd-84cf-b083686a228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:47.451970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 946/1895] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:47.456564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.523317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567b4f-9340-46b8-aee6-78ba0fdb3f4a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.528942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.529604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.529885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.530871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.530871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.532855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.618986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 950/1896] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:47 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:47.621534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbcb2e-65e5-41dd-84cf-b083686a228c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.633721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbcb2e-65e5-41dd-84cf-b083686a228c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.643820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.645822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:47.701510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.702179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.702512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.702799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.704180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.706224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.718193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead8342-895b-49b6-b537-990767135bf8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.723533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.724149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.724501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.724850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] PATH_INFO: `/v3/users/21b78fca5d0842d4879275399b9f1d84` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.726275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b78fca5d0842d4879275399b9f1d84)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.728376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.810547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 947/1897] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:47 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:47.811933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.822083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c49bfa-8f4c-46b3-aba7-6ee74afb0fe8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.828453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.829240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.832755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.832755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.832755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.832755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.847214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 948/1898] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:47.848556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:47.858414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a975235-a762-410a-b5e5-c56e716198e7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:47.863349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:47.864256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:47.864590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:47.864929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] PATH_INFO: `/v3/projects/d35e1e2742ac45aea40158b4d6836492/users/2fd245cc44e645d7abaee4156d282fae/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:47.881408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35e1e2742ac45aea40158b4d6836492, user_id=2fd245cc44e645d7abaee4156d282fae, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:47.884099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:47.940613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b78fca5d0842d4879275399b9f1d84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:47.947084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b78fca5d0842d4879275399b9f1d84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:47.970498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 949/1899] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:47 2022] PUT /identity/v3/projects/d35e1e2742ac45aea40158b4d6836492/users/2fd245cc44e645d7abaee4156d282fae/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:47.974651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:48.026241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b78fca5d0842d4879275399b9f1d84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:48.038620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cd90c-9f19-47bb-ac68-6d2145e7a0c3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:48.039661 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b78fca5d0842d4879275399b9f1d84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:48.040335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2b23a41a-05c3-4ccf-a187-6d6f6a0b7890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b78fca5d0842d4879275399b9f1d84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:48.043709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:48.044467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:48.044745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:48.045017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:48.045747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:48.047000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 951/1900] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:47 2022] DELETE /identity/v3/users/21b78fca5d0842d4879275399b9f1d84 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:48.048325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:48.051405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:48.051697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:48.051977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:48.059181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 950/1901] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:09:48.063785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:48.065535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:48.070671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:48.071894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:48.078952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5af95d-dca3-4c56-b131-c5570f0ebaf4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:48.135238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 952/1902] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:48.139353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf37b7-3590-4c82-a786-01f50b312681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:48.140254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf37b7-3590-4c82-a786-01f50b312681 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:48.140538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf37b7-3590-4c82-a786-01f50b312681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:48.140815 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf37b7-3590-4c82-a786-01f50b312681 admin admin] PATH_INFO: `/v3/projects/d35e1e2742ac45aea40158b4d6836492/users/2fd245cc44e645d7abaee4156d282fae/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:48.142827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf37b7-3590-4c82-a786-01f50b312681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35e1e2742ac45aea40158b4d6836492, user_id=2fd245cc44e645d7abaee4156d282fae, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:48.145572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf37b7-3590-4c82-a786-01f50b312681 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:48.146763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:48.148919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:48.165381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 951/1903] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:48 2022] PUT /identity/v3/projects/d35e1e2742ac45aea40158b4d6836492/users/2fd245cc44e645d7abaee4156d282fae/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:48.166998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:48.167387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:48.167854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:48.200882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] MFA Rules not processed for user `2fd245cc44e645d7abaee4156d282fae`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:48.202119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:48.231288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f7e72-3294-4ac4-8555-9ae7b2c66e46 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:48.293340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 952/1904] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:09:48.301707 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:48.304787 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:48.304787 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:48.304787 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:48.307311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:48.308727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:48.371809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:48.372575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3ad33-c267-4778-aeb9-3e9f00f3891e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:48.374024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:48.376892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede74f6-7fc5-407a-85a4-844aee1f7de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:48.377547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede74f6-7fc5-407a-85a4-844aee1f7de5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:48.377832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede74f6-7fc5-407a-85a4-844aee1f7de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:48.378116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede74f6-7fc5-407a-85a4-844aee1f7de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:48.380091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7ede74f6-7fc5-407a-85a4-844aee1f7de5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:48.399214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 953/1905] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:48.456374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede74f6-7fc5-407a-85a4-844aee1f7de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:48.457891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede74f6-7fc5-407a-85a4-844aee1f7de5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:48.468663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 953/1906] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:09:48.963858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:48.966472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:48.995832 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e3615-d215-479b-999e-0e01fc7028fb service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:49.011480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:49.012851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.013590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.014117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] PATH_INFO: `/v3/projects/d32d23df37de4b0db0edb55843ea765d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.016102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32d23df37de4b0db0edb55843ea765d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:49.018501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:49.209536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32d23df37de4b0db0edb55843ea765d', 'request_id': 'req-72dffa97-f933-4895-a6e4-bfdfdc3183fe'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:49.275637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32d23df37de4b0db0edb55843ea765d', 'request_id': 'req-72dffa97-f933-4895-a6e4-bfdfdc3183fe'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:49.286954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32d23df37de4b0db0edb55843ea765d', 'request_id': 'req-72dffa97-f933-4895-a6e4-bfdfdc3183fe'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:49.298874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] The token cache is being invalidate because project d32d23df37de4b0db0edb55843ea765d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:49.299294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:49.300294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-72dffa97-f933-4895-a6e4-bfdfdc3183fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:49.301887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 954/1907] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:48 2022] DELETE /identity/v3/projects/d32d23df37de4b0db0edb55843ea765d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:49.311781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed089c0-7574-4797-a7dc-b1027db3e8f4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.312283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed089c0-7574-4797-a7dc-b1027db3e8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.312386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed089c0-7574-4797-a7dc-b1027db3e8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.331783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8ed089c0-7574-4797-a7dc-b1027db3e8f4 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:49.335664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8ed089c0-7574-4797-a7dc-b1027db3e8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:49.397528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 954/1908] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:49.406025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4029-3d22-4f30-b221-7e7ea08d1170 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.406313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4029-3d22-4f30-b221-7e7ea08d1170 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.406590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4029-3d22-4f30-b221-7e7ea08d1170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.426929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7aec4029-3d22-4f30-b221-7e7ea08d1170 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:49.428159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7aec4029-3d22-4f30-b221-7e7ea08d1170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:49.436875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 955/1909] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:49.441309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed089c0-7574-4797-a7dc-b1027db3e8f4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:49.451020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed089c0-7574-4797-a7dc-b1027db3e8f4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:49.455873 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:49.456528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.456812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.457088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.457851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:09:49.458156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:49.459809 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:49.471834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 955/1910] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:09:49.476258 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec4029-3d22-4f30-b221-7e7ea08d1170 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:49.486321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec4029-3d22-4f30-b221-7e7ea08d1170 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:49.490929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:49.491616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.491901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.492175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.492871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:49.496630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:49.566445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 956/1911] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:09:49 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:09:49.571576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:49.581838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596cccb-6be1-46cb-8787-ae7b7ef61af9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:49.640568 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:49.641248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.642224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.642510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.643271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:49.645389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:49.738590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 956/1912] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:09:49 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:09:49.742511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:49.753451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cfc31d-baa9-489a-b811-ccd0226da783 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:49.758061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:49.758828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.759114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.759424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.760152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:49.761743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:49.772780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 957/1913] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:49.776731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:49.787246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefdb57-1d28-45ea-9b62-9998a308c900 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:49.792205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea7086-8bed-4d03-a225-90d745a88654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:49.792869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7086-8bed-4d03-a225-90d745a88654 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.793159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7086-8bed-4d03-a225-90d745a88654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.793472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea7086-8bed-4d03-a225-90d745a88654 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.794394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea7086-8bed-4d03-a225-90d745a88654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:49.796045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea7086-8bed-4d03-a225-90d745a88654 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:49.806027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 957/1914] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:09:49.810499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:49.820508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab243661-8460-4434-a639-89f925898ed1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:49.825842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:49.826879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.827250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.827531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] PATH_INFO: `/v3/projects/4cc31f15952547f0a886f18616f009f5/users/2f47a752ed3345efb76eb9315542ef60/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.843037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc31f15952547f0a886f18616f009f5, user_id=2f47a752ed3345efb76eb9315542ef60, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:49.845792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:49.942073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 958/1915] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:09:49 2022] PUT /identity/v3/projects/4cc31f15952547f0a886f18616f009f5/users/2f47a752ed3345efb76eb9315542ef60/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:09:49.952803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d713c-d1f2-4c90-8c2d-e0127ad1ec8a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:49.953158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d713c-d1f2-4c90-8c2d-e0127ad1ec8a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:49.953442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d713c-d1f2-4c90-8c2d-e0127ad1ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:49.981972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d85d713c-d1f2-4c90-8c2d-e0127ad1ec8a None None] MFA Rules not processed for user `2f47a752ed3345efb76eb9315542ef60`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:49.983094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d85d713c-d1f2-4c90-8c2d-e0127ad1ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:50.054121 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 958/1916] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:50.067097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:50.068969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:50.126560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f23f9-3f63-4651-bb24-e7544af77d1e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:50.130242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:50.130897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:50.131216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:50.131498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:50.140201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:50.141640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:50.150576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 959/1917] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:50 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:51.047717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d713c-d1f2-4c90-8c2d-e0127ad1ec8a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:51.057468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d713c-d1f2-4c90-8c2d-e0127ad1ec8a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:51.062506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:51.063213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:51.063672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:51.063950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:51.066018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:51.135077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:51.136500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:51.146833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 959/1918] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:53.102983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:53.104486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:53.121686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86143ede-5ed1-4dca-8a03-65968291b12f service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:53.124863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618875b-3ed7-4cba-94b7-575fe98d402f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:53.126420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618875b-3ed7-4cba-94b7-575fe98d402f service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:53.127077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618875b-3ed7-4cba-94b7-575fe98d402f service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:53.127457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618875b-3ed7-4cba-94b7-575fe98d402f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:53.129407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3618875b-3ed7-4cba-94b7-575fe98d402f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:53.202209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618875b-3ed7-4cba-94b7-575fe98d402f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:53.203750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618875b-3ed7-4cba-94b7-575fe98d402f service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:53.215061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 960/1919] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:58.271055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:58.272763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:58.343633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0133e5f-697c-4694-9f8f-af816f998331 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:58.348540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:58.350824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:58.350824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:58.350824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] PATH_INFO: `/v3/users/4e03e5777c2b4cf589a7641a0f480610` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:58.351224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e03e5777c2b4cf589a7641a0f480610)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:58.353237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:58.551803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e03e5777c2b4cf589a7641a0f480610'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:58.624549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e03e5777c2b4cf589a7641a0f480610'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:58.636932 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e03e5777c2b4cf589a7641a0f480610'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:58.637572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e03e5777c2b4cf589a7641a0f480610'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:58.644963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e03e5777c2b4cf589a7641a0f480610'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:58.650743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 960/1920] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:58 2022] DELETE /identity/v3/users/4e03e5777c2b4cf589a7641a0f480610 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:58.655646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:58.660925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:58.660925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:58.674048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:09:58.675298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:58.734245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 961/1921] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:09:58.743719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:58.745125 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:58.804383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0d3d0-9428-43f3-b326-dc239566ee8c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:58.808720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:58.809292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:58.809578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:58.809881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:58.821909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:58.822137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:58.833201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 961/1922] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:09:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:09:59.632301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:59.633839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:09:59.646239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8009f-86ed-4d5e-a4c4-fcc9cced5457 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:59.651545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:59.652659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:59.653138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:59.653427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] PATH_INFO: `/v3/projects/7f2856affb4b4bd4bf04d2ec68fd3451` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:59.654649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2856affb4b4bd4bf04d2ec68fd3451)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:59.656649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:09:59.778717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2856affb4b4bd4bf04d2ec68fd3451', 'request_id': 'req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:59.860145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2856affb4b4bd4bf04d2ec68fd3451', 'request_id': 'req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:59.865951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2856affb4b4bd4bf04d2ec68fd3451', 'request_id': 'req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:59.880107 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] The token cache is being invalidate because project 7f2856affb4b4bd4bf04d2ec68fd3451 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:09:59.880556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:59.881231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:09:59.882956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 962/1923] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:09:59 2022] DELETE /identity/v3/projects/7f2856affb4b4bd4bf04d2ec68fd3451 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:09:59.886918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:09:59.897294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc5a94-de62-4f13-b589-fd74f06d57ac service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:09:59.956286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:09:59.957162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:09:59.957443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:09:59.957732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] PATH_INFO: `/v3/users/038a7b39ae654ce38584459e1469a697` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:09:59.958938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] RBAC: Authorizing `identity:delete_user(user_id=038a7b39ae654ce38584459e1469a697)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:09:59.960918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:00.157744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038a7b39ae654ce38584459e1469a697'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.249184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038a7b39ae654ce38584459e1469a697'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.262022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038a7b39ae654ce38584459e1469a697'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.262721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038a7b39ae654ce38584459e1469a697'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.269592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038a7b39ae654ce38584459e1469a697'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.275549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 962/1924] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:09:59 2022] DELETE /identity/v3/users/038a7b39ae654ce38584459e1469a697 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:00.711167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:00.712831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:00.728245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7bdf4-a22c-4720-88f8-7e9bf23c3441 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:00.797861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:00.800035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:00.800548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:00.801061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] PATH_INFO: `/v3/projects/7724d38dc2da4ab7b3f76465e8f91e7a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:00.802550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7724d38dc2da4ab7b3f76465e8f91e7a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:00.805063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:00.905752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7724d38dc2da4ab7b3f76465e8f91e7a', 'request_id': 'req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.936698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:00.938168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:00.951022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741f13b-d3f0-4180-a7c1-66133e1905db admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:00.977872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7724d38dc2da4ab7b3f76465e8f91e7a', 'request_id': 'req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.984323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7724d38dc2da4ab7b3f76465e8f91e7a', 'request_id': 'req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.996163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] The token cache is being invalidate because project 7724d38dc2da4ab7b3f76465e8f91e7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:00.996555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.997455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:00.999861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 963/1925] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:00 2022] DELETE /identity/v3/projects/7724d38dc2da4ab7b3f76465e8f91e7a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:01.003617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:01.005027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:01.011446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:01.012391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:01.012676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:01.012958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] PATH_INFO: `/v3/users/075f3cdf0d084f35bc0d2ef8c8b40808` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:01.014767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=075f3cdf0d084f35bc0d2ef8c8b40808)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:01.016753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:01.071893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c1fc0-2eb2-4d67-9e58-1df4e53f8371 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:01.077172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:01.078052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:01.078333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:01.078614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] PATH_INFO: `/v3/users/2fd245cc44e645d7abaee4156d282fae` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:01.080049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd245cc44e645d7abaee4156d282fae)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:01.081997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:01.171063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075f3cdf0d084f35bc0d2ef8c8b40808'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.252396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd245cc44e645d7abaee4156d282fae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.262099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd245cc44e645d7abaee4156d282fae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.265345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075f3cdf0d084f35bc0d2ef8c8b40808'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.282921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075f3cdf0d084f35bc0d2ef8c8b40808'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.283789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075f3cdf0d084f35bc0d2ef8c8b40808'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.294262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-e335e495-cb2e-4c6c-8bf6-ac62834664bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075f3cdf0d084f35bc0d2ef8c8b40808'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.304152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 963/1926] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:00 2022] DELETE /identity/v3/users/075f3cdf0d084f35bc0d2ef8c8b40808 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:01.308585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:01.309125 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:01.309551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:01.334533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:01.336446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:01.360901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd245cc44e645d7abaee4156d282fae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.388700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd245cc44e645d7abaee4156d282fae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.389554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd245cc44e645d7abaee4156d282fae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:01.402607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 964/1927] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:01.405005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 964/1928] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:01 2022] DELETE /identity/v3/users/2fd245cc44e645d7abaee4156d282fae => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:01.412983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:01.414452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:01.495435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5a7b-6c23-41b3-934c-d05450ba747c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:01.565343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:01.566099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:01.566457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:01.566831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:01.645705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:01.647270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:01.658997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 965/1929] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:01.870510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:01.872348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:01.887531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57f73a-f1f1-4782-ab1c-b9896064c958 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:01.892704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:01.893585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:01.893872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:01.894160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] PATH_INFO: `/v3/projects/d35e1e2742ac45aea40158b4d6836492` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:01.895426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35e1e2742ac45aea40158b4d6836492)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:01.897533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.031140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35e1e2742ac45aea40158b4d6836492', 'request_id': 'req-f42c3726-e266-4065-a0c7-0f905385f0e5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.078775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.080338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:02.093578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a18348-39a3-47ed-a422-bdde60b66693 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.102724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35e1e2742ac45aea40158b4d6836492', 'request_id': 'req-f42c3726-e266-4065-a0c7-0f905385f0e5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.108522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35e1e2742ac45aea40158b4d6836492', 'request_id': 'req-f42c3726-e266-4065-a0c7-0f905385f0e5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.121944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] The token cache is being invalidate because project d35e1e2742ac45aea40158b4d6836492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:02.122290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.123050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f42c3726-e266-4065-a0c7-0f905385f0e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.125208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 965/1930] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:01 2022] DELETE /identity/v3/projects/d35e1e2742ac45aea40158b4d6836492 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:02.131483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f07ae8-e534-4af2-ae30-7fc8cd19c83b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.131769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f07ae8-e534-4af2-ae30-7fc8cd19c83b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.132504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f07ae8-e534-4af2-ae30-7fc8cd19c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.156675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-38f07ae8-e534-4af2-ae30-7fc8cd19c83b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:02.157924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-38f07ae8-e534-4af2-ae30-7fc8cd19c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:02.159813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.161204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.161673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.162138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] PATH_INFO: `/v3/projects/9fbf7c3a6ce44ddb845eb1e5e9683e34` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.164051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fbf7c3a6ce44ddb845eb1e5e9683e34)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.167492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.169756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 966/1931] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:02.182854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb83b4f-7b8f-4b2c-8d9f-13f97adaad65 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.183351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb83b4f-7b8f-4b2c-8d9f-13f97adaad65 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.183806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb83b4f-7b8f-4b2c-8d9f-13f97adaad65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.209850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cdb83b4f-7b8f-4b2c-8d9f-13f97adaad65 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:02.222223 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cdb83b4f-7b8f-4b2c-8d9f-13f97adaad65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:02.222223 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 967/1932] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:02.225041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb83b4f-7b8f-4b2c-8d9f-13f97adaad65 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.234981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb83b4f-7b8f-4b2c-8d9f-13f97adaad65 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.239605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.240238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.240522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.240799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.241532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:02.241822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.243437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.255070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 968/1933] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:10:02.259158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.268964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518969-917b-4db2-b1b4-048ae9aac842 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.273667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.280333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.280333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.280333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.280333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.280333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.314926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fbf7c3a6ce44ddb845eb1e5e9683e34', 'request_id': 'req-ca53f11b-6e85-4679-8c9b-2332715bd632'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.320110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fbf7c3a6ce44ddb845eb1e5e9683e34', 'request_id': 'req-ca53f11b-6e85-4679-8c9b-2332715bd632'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.326315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fbf7c3a6ce44ddb845eb1e5e9683e34', 'request_id': 'req-ca53f11b-6e85-4679-8c9b-2332715bd632'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.375966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 969/1934] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:02 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:02.379729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.402431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] The token cache is being invalidate because project 9fbf7c3a6ce44ddb845eb1e5e9683e34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:02.402722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.416852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.420727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 966/1935] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:02 2022] DELETE /identity/v3/projects/9fbf7c3a6ce44ddb845eb1e5e9683e34 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:02.425664 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.432555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:02.456923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86c8a7-6de7-4ea4-b0cb-dc22517fb241 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.471076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.471853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.472135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.472558 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.473289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.475409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.505026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53f11b-6e85-4679-8c9b-2332715bd632 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.509930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.510830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.511113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.511443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] PATH_INFO: `/v3/users/61c19e7db5b74421bd372b9962bc5e1a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.512697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c19e7db5b74421bd372b9962bc5e1a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.514652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.568439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 970/1936] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:02 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:02.572344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.574002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:02.586457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9858272d-90f9-4a7c-aee7-d17ff91a17d8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.591362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.592021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.592297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.592567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.593354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.595112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.609635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 971/1937] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:02.613425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.623862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92874f9c-bbed-4271-9287-6d7b7837c08a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.629653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.637581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.637581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.637581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.637581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.637581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.645750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 972/1938] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:02.649788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.660335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c18d69-1a97-4e71-94ad-3a694f29b3d6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:02.665850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f3dc6-5e6e-46e3-b301-73a1ff40a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:02.666824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3dc6-5e6e-46e3-b301-73a1ff40a839 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.667111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3dc6-5e6e-46e3-b301-73a1ff40a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.667418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3dc6-5e6e-46e3-b301-73a1ff40a839 admin admin] PATH_INFO: `/v3/projects/e85901c514f745f8b3f373fb9d6209ff/users/dec4ba2e04c842afbdc4a1338ab91c42/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.684778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f3dc6-5e6e-46e3-b301-73a1ff40a839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85901c514f745f8b3f373fb9d6209ff, user_id=dec4ba2e04c842afbdc4a1338ab91c42, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:02.688667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f3dc6-5e6e-46e3-b301-73a1ff40a839 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:02.783618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c19e7db5b74421bd372b9962bc5e1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.821569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 973/1939] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:02 2022] PUT /identity/v3/projects/e85901c514f745f8b3f373fb9d6209ff/users/dec4ba2e04c842afbdc4a1338ab91c42/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:02.830687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:02.831023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:02.831393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:02.869804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] MFA Rules not processed for user `dec4ba2e04c842afbdc4a1338ab91c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:02.871230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:02.886125 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c19e7db5b74421bd372b9962bc5e1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.899827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c19e7db5b74421bd372b9962bc5e1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.900603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c19e7db5b74421bd372b9962bc5e1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.908528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c19e7db5b74421bd372b9962bc5e1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:02.915606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 967/1940] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:02 2022] DELETE /identity/v3/users/61c19e7db5b74421bd372b9962bc5e1a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:02.944952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 974/1941] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:02.957823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:02.960829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:03.028087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244620ae-45e8-4c62-9ec2-7ff9fec3c757 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:03.032419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c7dc6-0715-4f2e-9a4a-0d8875707c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:03.033072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7dc6-0715-4f2e-9a4a-0d8875707c8c service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:03.033359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7dc6-0715-4f2e-9a4a-0d8875707c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:03.033637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c7dc6-0715-4f2e-9a4a-0d8875707c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:03.088687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c7dc6-0715-4f2e-9a4a-0d8875707c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:03.090276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c7dc6-0715-4f2e-9a4a-0d8875707c8c service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:03.099938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 968/1942] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:03.350663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:03.352142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:03.447366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02446f7e-d4d9-4fa9-9dd4-373aca911331 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:03.526462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:03.527531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:03.527936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:03.528349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] PATH_INFO: `/v3/projects/c8047913145f42f998caecbada03f68b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:03.529947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8047913145f42f998caecbada03f68b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:03.532642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:03.663999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8047913145f42f998caecbada03f68b', 'request_id': 'req-8ca6bcde-b3a0-4313-b6de-88ef2908f813'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:03.773306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8047913145f42f998caecbada03f68b', 'request_id': 'req-8ca6bcde-b3a0-4313-b6de-88ef2908f813'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:03.782536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8047913145f42f998caecbada03f68b', 'request_id': 'req-8ca6bcde-b3a0-4313-b6de-88ef2908f813'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:03.813548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] The token cache is being invalidate because project c8047913145f42f998caecbada03f68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:03.813850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:03.815517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ca6bcde-b3a0-4313-b6de-88ef2908f813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:03.823190 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 975/1943] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:03 2022] DELETE /identity/v3/projects/c8047913145f42f998caecbada03f68b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:03.828657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda00fee-bcc4-4f17-9b65-67145bfbe70b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:03.829474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda00fee-bcc4-4f17-9b65-67145bfbe70b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:03.829886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda00fee-bcc4-4f17-9b65-67145bfbe70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:03.861041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cda00fee-bcc4-4f17-9b65-67145bfbe70b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:03.862448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cda00fee-bcc4-4f17-9b65-67145bfbe70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:03.955180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 969/1944] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:03.969079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553eb00-e1cb-4293-a252-fd37118ed7b1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:03.969079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553eb00-e1cb-4293-a252-fd37118ed7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:03.969079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8553eb00-e1cb-4293-a252-fd37118ed7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:03.986898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8553eb00-e1cb-4293-a252-fd37118ed7b1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:03.988448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8553eb00-e1cb-4293-a252-fd37118ed7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:04.000776 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 976/1945] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:04.005929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda00fee-bcc4-4f17-9b65-67145bfbe70b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.020707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda00fee-bcc4-4f17-9b65-67145bfbe70b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.027016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.031774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.031774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.031774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.031774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:04.031774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.031774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:04.047101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 970/1946] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:10:04.051338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553eb00-e1cb-4293-a252-fd37118ed7b1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.065536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8553eb00-e1cb-4293-a252-fd37118ed7b1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.080111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.080901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.081197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.081483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.082199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.089986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:04.192006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 977/1947] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:04 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:04.193060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.205754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96194d03-686f-4ac4-9078-a09c238874be admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.308542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.309229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.309610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.309856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.310541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.313931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:04.420892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 971/1948] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:04 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:04.425071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.435639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa39013-62ae-493c-a8f3-35c2ad747219 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.441149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.441938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.442320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.442681 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.443486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.447612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:04.457690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 978/1949] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:04.461725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.472206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4e228-32f9-46b6-a98b-673f18a5a2db admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.476962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17da16-0e75-4cdc-947e-40abcbd25f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.477615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17da16-0e75-4cdc-947e-40abcbd25f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.477900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17da16-0e75-4cdc-947e-40abcbd25f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.478180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17da16-0e75-4cdc-947e-40abcbd25f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.478916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17da16-0e75-4cdc-947e-40abcbd25f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.480536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17da16-0e75-4cdc-947e-40abcbd25f20 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:04.490912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 972/1950] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:04.495092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.505485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482da9-c3cd-4f6d-99b2-eee2653305f0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.510058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.519616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.519616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.519616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] PATH_INFO: `/v3/projects/70c243fd4e4c47beb7f6c226abe8d51d/users/e386aa480b844434bc0ffd304ce27abb/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.527510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c243fd4e4c47beb7f6c226abe8d51d, user_id=e386aa480b844434bc0ffd304ce27abb, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.530232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:04.613071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 979/1951] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:04 2022] PUT /identity/v3/projects/70c243fd4e4c47beb7f6c226abe8d51d/users/e386aa480b844434bc0ffd304ce27abb/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:04.623585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ec10-1e53-4b69-89cf-449a8b65c99c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.623877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ec10-1e53-4b69-89cf-449a8b65c99c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.624161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887ec10-1e53-4b69-89cf-449a8b65c99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.651857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6887ec10-1e53-4b69-89cf-449a8b65c99c None None] MFA Rules not processed for user `e386aa480b844434bc0ffd304ce27abb`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:04.653060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6887ec10-1e53-4b69-89cf-449a8b65c99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:04.723046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 973/1952] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:04.727466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.797131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f601cb-4d0d-4a8e-8520-631eff249c21 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.807339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.808005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.817178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.817178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.817178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.817178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:04.898309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 980/1953] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:04 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:04.899657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887ec10-1e53-4b69-89cf-449a8b65c99c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:04.911471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887ec10-1e53-4b69-89cf-449a8b65c99c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:04.972668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:04.973291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:04.973575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:04.973858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:04.974563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:04.976555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:05.059878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 974/1954] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:04 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:05.064449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:05.074764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9066c-0dbd-4853-910c-c2751d4c7bdd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:05.079528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:05.080177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:05.080458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:05.080735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:05.081556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:05.083166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:05.097781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 981/1955] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:05.099555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:05.110599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c067310-2bc7-41bf-8f3a-51d63e22af4e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:05.115458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:05.116516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:05.116768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:05.117043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] PATH_INFO: `/v3/projects/1f05c391a9d7480eadfd13908ac7ba56/users/047dc3f144d0470da63568e15f26dc88/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:05.133162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f05c391a9d7480eadfd13908ac7ba56, user_id=047dc3f144d0470da63568e15f26dc88, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:05.136026 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:05.231663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 975/1956] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:05 2022] PUT /identity/v3/projects/1f05c391a9d7480eadfd13908ac7ba56/users/047dc3f144d0470da63568e15f26dc88/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:05.236593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:05.246411 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac6d55-f977-4779-b962-c557c58fc425 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:05.310207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36629381-71d8-4b73-a3d6-9c1bb8f3e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:05.311586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629381-71d8-4b73-a3d6-9c1bb8f3e003 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:05.311948 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629381-71d8-4b73-a3d6-9c1bb8f3e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:05.312328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36629381-71d8-4b73-a3d6-9c1bb8f3e003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:05.313075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629381-71d8-4b73-a3d6-9c1bb8f3e003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:05.314670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36629381-71d8-4b73-a3d6-9c1bb8f3e003 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:05.332262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 982/1957] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:05.333241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:05.349573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f3e822-fbb4-4d5c-b859-4e50384fe9a9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:05.361214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:05.363903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:05.365427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:05.366396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] PATH_INFO: `/v3/projects/1f05c391a9d7480eadfd13908ac7ba56/users/047dc3f144d0470da63568e15f26dc88/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:05.371691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f05c391a9d7480eadfd13908ac7ba56, user_id=047dc3f144d0470da63568e15f26dc88, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:05.377022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:05.395167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 976/1958] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:05 2022] PUT /identity/v3/projects/1f05c391a9d7480eadfd13908ac7ba56/users/047dc3f144d0470da63568e15f26dc88/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:05.412574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:05.412858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:05.413143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:05.448969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] MFA Rules not processed for user `047dc3f144d0470da63568e15f26dc88`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:05.450246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:05.533404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 983/1959] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:05.545582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:05.547773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:05.631231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36decc14-5164-4d2d-9caf-6fedd8403983 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:05.635173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e33ef3a-0df2-4cff-bc05-a5c8563af7e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:05.635845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ef3a-0df2-4cff-bc05-a5c8563af7e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:05.636125 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ef3a-0df2-4cff-bc05-a5c8563af7e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:05.636402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e33ef3a-0df2-4cff-bc05-a5c8563af7e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:05.694587 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ef3a-0df2-4cff-bc05-a5c8563af7e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:05.696057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e33ef3a-0df2-4cff-bc05-a5c8563af7e5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:05.705626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 977/1960] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:06.171077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:06.173248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:06.243021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6e7e-56e8-45ac-a5cd-1433adc17a2e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:06.248917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:06.250063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:06.250341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:06.250617 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] PATH_INFO: `/v3/users/dec4ba2e04c842afbdc4a1338ab91c42` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:06.251824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dec4ba2e04c842afbdc4a1338ab91c42)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:06.253774 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:06.482364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dec4ba2e04c842afbdc4a1338ab91c42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:06.489614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dec4ba2e04c842afbdc4a1338ab91c42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:06.620045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dec4ba2e04c842afbdc4a1338ab91c42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:06.642028 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dec4ba2e04c842afbdc4a1338ab91c42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:06.649099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dec4ba2e04c842afbdc4a1338ab91c42'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:06.656887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 984/1961] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:06 2022] DELETE /identity/v3/users/dec4ba2e04c842afbdc4a1338ab91c42 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:06.661415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:06.661870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:06.662216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:06.680870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:06.682332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:06.748533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 978/1962] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:06.758417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:06.759886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:06.818128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a842fe1-50bf-4fe1-8f47-056991e57e80 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:06.821739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef5b89-3f79-455f-ae3b-02921f68fd5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:06.822394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5b89-3f79-455f-ae3b-02921f68fd5e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:06.822677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5b89-3f79-455f-ae3b-02921f68fd5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:06.822953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef5b89-3f79-455f-ae3b-02921f68fd5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:06.832255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef5b89-3f79-455f-ae3b-02921f68fd5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:06.833697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef5b89-3f79-455f-ae3b-02921f68fd5e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:06.844000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 985/1963] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:07.365358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:07.366760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:07.379100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fea50-5d77-4f74-9895-506428db00ec None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:07.384622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:07.386274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:07.386609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:07.387235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] PATH_INFO: `/v3/projects/e85901c514f745f8b3f373fb9d6209ff` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:07.388565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85901c514f745f8b3f373fb9d6209ff)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:07.391152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:07.500906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85901c514f745f8b3f373fb9d6209ff', 'request_id': 'req-68f944d1-0e22-4738-80fe-2be0321e15c5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:07.506456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85901c514f745f8b3f373fb9d6209ff', 'request_id': 'req-68f944d1-0e22-4738-80fe-2be0321e15c5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:07.512632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85901c514f745f8b3f373fb9d6209ff', 'request_id': 'req-68f944d1-0e22-4738-80fe-2be0321e15c5'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:07.623167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] The token cache is being invalidate because project e85901c514f745f8b3f373fb9d6209ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:07.623522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:07.629578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68f944d1-0e22-4738-80fe-2be0321e15c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:07.629578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 979/1964] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:07 2022] DELETE /identity/v3/projects/e85901c514f745f8b3f373fb9d6209ff => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:07.630965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac8cab-4314-47af-a756-435632710c13 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:07.631436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac8cab-4314-47af-a756-435632710c13 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:07.631529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac8cab-4314-47af-a756-435632710c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:07.650073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-86ac8cab-4314-47af-a756-435632710c13 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:07.651334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86ac8cab-4314-47af-a756-435632710c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:07.711250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 986/1965] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:07.720871 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4f06b-7e4c-47ab-99b4-e5158b0bd4c0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:07.721394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4f06b-7e4c-47ab-99b4-e5158b0bd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:07.721497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4f06b-7e4c-47ab-99b4-e5158b0bd4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:07.740731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f1b4f06b-7e4c-47ab-99b4-e5158b0bd4c0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:07.742224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f1b4f06b-7e4c-47ab-99b4-e5158b0bd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:07.752433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 980/1966] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:07.756679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac8cab-4314-47af-a756-435632710c13 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:07.767665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ac8cab-4314-47af-a756-435632710c13 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:07.772414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:07.773079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:07.773366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:07.773647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:07.774407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:07.774718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:07.776522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:07.793474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 987/1967] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:10:07.795233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4f06b-7e4c-47ab-99b4-e5158b0bd4c0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:07.805115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4f06b-7e4c-47ab-99b4-e5158b0bd4c0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:07.810217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:07.811060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:07.811774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:07.815818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:07.815818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:07.815818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:07.918880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 981/1968] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:07 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:07.922709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:07.933004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9adc9-766f-4fea-b81b-9f7bace936b2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:07.992548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:07.993277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:07.993547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:07.997464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:07.997464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:07.997464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:08.106858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 988/1969] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:07 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:08.111200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:08.121373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe29d50-5b5b-4d02-9250-cb610c84ddc7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:08.135243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:08.135243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:08.135243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:08.135243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:08.135847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:08.135847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:08.142461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 982/1970] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:08.146653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:08.156635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5d74d-1069-4d3d-9bb3-c5ff75bc08c6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:08.162500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72d1b-ad89-4a6b-89ad-3bc2d6516029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:08.163335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72d1b-ad89-4a6b-89ad-3bc2d6516029 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:08.163602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72d1b-ad89-4a6b-89ad-3bc2d6516029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:08.163916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72d1b-ad89-4a6b-89ad-3bc2d6516029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:08.164855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b72d1b-ad89-4a6b-89ad-3bc2d6516029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:08.166454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b72d1b-ad89-4a6b-89ad-3bc2d6516029 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:08.179368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 989/1971] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:08.183509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:08.193842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03eb81-c6eb-4d44-90dc-9ab5ece4b93c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:08.198493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:08.199480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:08.199826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:08.200208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] PATH_INFO: `/v3/projects/8abade24e5cf4763994f1d8eb8179f2e/users/1d8a2b2f122a45169aaff1df3a1b472e/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:08.215101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abade24e5cf4763994f1d8eb8179f2e, user_id=1d8a2b2f122a45169aaff1df3a1b472e, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:08.217924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:08.309738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 983/1972] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:08 2022] PUT /identity/v3/projects/8abade24e5cf4763994f1d8eb8179f2e/users/1d8a2b2f122a45169aaff1df3a1b472e/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:08.322185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11699-f361-40fb-bec1-8e4997eaa815 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:08.322479 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11699-f361-40fb-bec1-8e4997eaa815 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:08.322760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b11699-f361-40fb-bec1-8e4997eaa815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:08.351956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-72b11699-f361-40fb-bec1-8e4997eaa815 None None] MFA Rules not processed for user `1d8a2b2f122a45169aaff1df3a1b472e`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:08.353556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-72b11699-f361-40fb-bec1-8e4997eaa815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:08.431282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 990/1973] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:08.448931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:08.451584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:08.512353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ee524-26c0-4f27-b036-2b75ceb23593 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:08.516119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:08.517506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:08.517812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:08.518434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:08.528257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:08.530058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:08.540390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 984/1974] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:08.569286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b11699-f361-40fb-bec1-8e4997eaa815 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:08.649857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b11699-f361-40fb-bec1-8e4997eaa815 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:08.654789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:08.655679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:08.655952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:08.656219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] PATH_INFO: `/v3/users/1d8a2b2f122a45169aaff1df3a1b472e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:08.658050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8a2b2f122a45169aaff1df3a1b472e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:08.659996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:08.816113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:08.817673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:08.833494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a513b-0deb-4660-be69-bde15138070c service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:08.838176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:08.839138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:08.839439 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:08.839715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] PATH_INFO: `/v3/users/00678cc05f4a40aa86503052b0d067f4` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:08.840915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=00678cc05f4a40aa86503052b0d067f4)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:08.842814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:08.892485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8a2b2f122a45169aaff1df3a1b472e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:08.899695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8a2b2f122a45169aaff1df3a1b472e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.008512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8a2b2f122a45169aaff1df3a1b472e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.022009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8a2b2f122a45169aaff1df3a1b472e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.022732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-49a96efa-e9f8-4338-84b4-adaaeb4af5e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8a2b2f122a45169aaff1df3a1b472e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.028942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 991/1975] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:08 2022] DELETE /identity/v3/users/1d8a2b2f122a45169aaff1df3a1b472e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:09.034062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:09.034424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:09.034702 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:09.053088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:09.054305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:09.085330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00678cc05f4a40aa86503052b0d067f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.117447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 992/1976] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:09.127600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:09.129567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:09.171957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00678cc05f4a40aa86503052b0d067f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.185751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00678cc05f4a40aa86503052b0d067f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.187166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00678cc05f4a40aa86503052b0d067f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.188836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6b715-0688-4ffd-a4c6-f814a996aecb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:09.193473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:09.199473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:09.199473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:09.199473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:09.199473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:09.200567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00678cc05f4a40aa86503052b0d067f4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.209028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 985/1977] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:08 2022] DELETE /identity/v3/users/00678cc05f4a40aa86503052b0d067f4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:09.221934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:09.223696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:09.236164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 993/1978] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:10:09.510763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:09.512703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:09.595989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c23682-43a7-42e2-9352-5813f8389dbd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:09.602064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:09.602999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:09.603383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:09.603722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] PATH_INFO: `/v3/projects/9ec69436f8724e48af59f1b87f22b9ac` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:09.607245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec69436f8724e48af59f1b87f22b9ac)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:09.611747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:09.668056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:09.669189 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:09.682171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67125ebe-74e2-4725-bdd9-f93712da4a91 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:09.687340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:09.688428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:09.688982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:09.688982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] PATH_INFO: `/v3/projects/8abade24e5cf4763994f1d8eb8179f2e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:09.690223 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abade24e5cf4763994f1d8eb8179f2e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:09.699548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:09.757469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec69436f8724e48af59f1b87f22b9ac', 'request_id': 'req-ec982d21-05cf-4b19-8425-f75864be124b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.763148 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec69436f8724e48af59f1b87f22b9ac', 'request_id': 'req-ec982d21-05cf-4b19-8425-f75864be124b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.770216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec69436f8724e48af59f1b87f22b9ac', 'request_id': 'req-ec982d21-05cf-4b19-8425-f75864be124b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.827847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abade24e5cf4763994f1d8eb8179f2e', 'request_id': 'req-2ffcc85a-f878-4a0c-97e5-08af8f50f436'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.842713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] The token cache is being invalidate because project 9ec69436f8724e48af59f1b87f22b9ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:09.843537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.843678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ec982d21-05cf-4b19-8425-f75864be124b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.845840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 986/1979] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:09 2022] DELETE /identity/v3/projects/9ec69436f8724e48af59f1b87f22b9ac => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:09.853157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4cebc-5147-46d4-8050-94e60046e8d3 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:09.853444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4cebc-5147-46d4-8050-94e60046e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:09.853700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4cebc-5147-46d4-8050-94e60046e8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:09.879474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-49c4cebc-5147-46d4-8050-94e60046e8d3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:09.879474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-49c4cebc-5147-46d4-8050-94e60046e8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:09.941425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 987/1980] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:09.945812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abade24e5cf4763994f1d8eb8179f2e', 'request_id': 'req-2ffcc85a-f878-4a0c-97e5-08af8f50f436'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.949419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f14501-654f-4112-bc95-16d7c31e4bbc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:09.949736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f14501-654f-4112-bc95-16d7c31e4bbc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:09.956802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f14501-654f-4112-bc95-16d7c31e4bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:09.956974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abade24e5cf4763994f1d8eb8179f2e', 'request_id': 'req-2ffcc85a-f878-4a0c-97e5-08af8f50f436'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.965102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] The token cache is being invalidate because project 8abade24e5cf4763994f1d8eb8179f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:09.965471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.966182 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2ffcc85a-f878-4a0c-97e5-08af8f50f436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:09.967868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 994/1981] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:09 2022] DELETE /identity/v3/projects/8abade24e5cf4763994f1d8eb8179f2e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:09.972260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-01f14501-654f-4112-bc95-16d7c31e4bbc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:09.972837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec288-f165-4e8b-8e3d-ff502a1f5e99 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:09.973131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec288-f165-4e8b-8e3d-ff502a1f5e99 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:09.973412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341ec288-f165-4e8b-8e3d-ff502a1f5e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:09.973515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-01f14501-654f-4112-bc95-16d7c31e4bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:09.981909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 988/1982] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:09.987211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f14501-654f-4112-bc95-16d7c31e4bbc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:09.993442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-341ec288-f165-4e8b-8e3d-ff502a1f5e99 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:09.994578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-341ec288-f165-4e8b-8e3d-ff502a1f5e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:10.000009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f14501-654f-4112-bc95-16d7c31e4bbc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.002616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.003363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.003613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.003800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 995/1983] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:10.004032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.004611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:10.004918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.006539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.011406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df010c-50fc-42e6-a3fa-8b3cb3f4eee5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.011560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df010c-50fc-42e6-a3fa-8b3cb3f4eee5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.011991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df010c-50fc-42e6-a3fa-8b3cb3f4eee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.023709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 989/1984] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:10:10.032002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d7df010c-50fc-42e6-a3fa-8b3cb3f4eee5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:10.033229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d7df010c-50fc-42e6-a3fa-8b3cb3f4eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:10.040271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.045800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 996/1985] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:10.046941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df010c-50fc-42e6-a3fa-8b3cb3f4eee5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.055878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44fe5a-3d2e-4d81-8305-4fa602e62f4e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.057317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df010c-50fc-42e6-a3fa-8b3cb3f4eee5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.062981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.065139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.065284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.066184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.066541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.066902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.067733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.069790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.071690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.072184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.073230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:10.073526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.075393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.088580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 997/1986] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:10:10.093336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.104353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d546c2c-1dc5-4745-bf51-52781e0d28ad admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.123283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.123283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.123283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.123283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.123663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.123663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.243827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 998/1987] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:10.244455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 990/1988] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:10.255674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.255939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.327609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45762b6e-85f0-4f72-9872-ee2e26a86bbd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.332645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.333105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4128f1-d3a7-4440-a800-efcdc78a28c0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.333330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.333611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.333888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.334600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.336697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.338439 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.339131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.339433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.339713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.340475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.342596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.415016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 991/1989] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:10.415693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 999/1990] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:10.419023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.419385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.429956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3b9a3-c2c6-4a6f-947d-7b62483074a7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.430128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d76d072-f45a-4c10-8b8e-1a603373eaac admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.434590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.434783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.435376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.435547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.435679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.435884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.436001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.436437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.436913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.437176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.438982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.439268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.449239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 992/1991] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:10.452195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1000/1992] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:10.453058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.453172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.462926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca02b29-b554-44d0-b2a1-89cff3e2eea9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.463311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f4ed-c800-4e9a-8703-48cbdc28e835 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.467693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.468123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.468333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.468614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.468773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.468888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.469066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.469837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.470450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.470554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.472072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.472196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.482253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1001/1993] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:10.486670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 993/1994] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:10.487218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.487621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.496800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998c82b-367f-4992-84f5-53d79828eca4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.497011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb587583-0c38-495b-8cee-f62f49ef9a43 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.501716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20f076-9209-485e-bd97-efeb06c251e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.502076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932cba1-024f-4cd8-a7b1-90c6cabe5a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.502585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20f076-9209-485e-bd97-efeb06c251e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.502863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20f076-9209-485e-bd97-efeb06c251e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.502970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cba1-024f-4cd8-a7b1-90c6cabe5a93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.503164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20f076-9209-485e-bd97-efeb06c251e1 admin admin] PATH_INFO: `/v3/projects/57a4fd3197054716b37d90b04d2bd3fc/users/fce23710f7694456b5866be242da4882/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.503263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cba1-024f-4cd8-a7b1-90c6cabe5a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.503537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932cba1-024f-4cd8-a7b1-90c6cabe5a93 admin admin] PATH_INFO: `/v3/projects/b51f628be6144a698276671df56eac18/users/842fa4b1c86e4c208ab1f1f119d3bdd8/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.517896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20f076-9209-485e-bd97-efeb06c251e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a4fd3197054716b37d90b04d2bd3fc, user_id=fce23710f7694456b5866be242da4882, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.518069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932cba1-024f-4cd8-a7b1-90c6cabe5a93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b51f628be6144a698276671df56eac18, user_id=842fa4b1c86e4c208ab1f1f119d3bdd8, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.520592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20f076-9209-485e-bd97-efeb06c251e1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.520728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932cba1-024f-4cd8-a7b1-90c6cabe5a93 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.598092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1002/1995] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:10 2022] PUT /identity/v3/projects/57a4fd3197054716b37d90b04d2bd3fc/users/fce23710f7694456b5866be242da4882/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:10.608144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d13df-4db8-4a2f-b4c0-cb3ba79ebab3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.608430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d13df-4db8-4a2f-b4c0-cb3ba79ebab3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.608713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d13df-4db8-4a2f-b4c0-cb3ba79ebab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.625430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 994/1996] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:10 2022] PUT /identity/v3/projects/b51f628be6144a698276671df56eac18/users/842fa4b1c86e4c208ab1f1f119d3bdd8/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:10.630498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.630788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.631067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.636110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-586d13df-4db8-4a2f-b4c0-cb3ba79ebab3 None None] MFA Rules not processed for user `fce23710f7694456b5866be242da4882`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:10.637328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-586d13df-4db8-4a2f-b4c0-cb3ba79ebab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:10.648315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:10.649577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:10.702062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1003/1997] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:10.706762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d13df-4db8-4a2f-b4c0-cb3ba79ebab3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.707623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 995/1998] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:10.717030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.717545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d13df-4db8-4a2f-b4c0-cb3ba79ebab3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.718466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:10.722341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.722995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.723327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.723615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.724305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.726233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.775896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73ce7a1-8101-4c26-82e5-247950c5cc95 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.779873 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.780589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.780918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.781225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.794472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.796048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:10.806552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1004/1999] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:10.806747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 996/2000] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:10:10.807861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:10.879062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813fddf-384b-41ed-b5d6-b5cf46a37cc8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:10.883932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:10.884606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:10.884986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:10.885259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:10.885959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:10.887923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.003163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1005/2001] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:10 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:11.004054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:11.013911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381d8e3-157a-4b80-8b05-95af89250997 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:11.020046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:11.020713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.020999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.021360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.022097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:11.023785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.035524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 997/2002] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:11.039874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:11.049060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:11.050791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:11.051486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99187cf5-8530-4f0d-b19c-c89e81b86daf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:11.056316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:11.057265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.057628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.057906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] PATH_INFO: `/v3/projects/67cc59da8e0a40d58aa7329111552833/users/4d80e4f7588141df85848f692749425c/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.074552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc59da8e0a40d58aa7329111552833, user_id=4d80e4f7588141df85848f692749425c, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:11.077278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.115942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99877fa2-ff5e-4228-a71f-a660154e46ec admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:11.123052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:11.123052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.123052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.123052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.124297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:11.169927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1006/2003] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:11 2022] PUT /identity/v3/projects/67cc59da8e0a40d58aa7329111552833/users/4d80e4f7588141df85848f692749425c/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:11.174338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:11.193828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:11.195325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.204987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 998/2004] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:10:11.237997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0052c-90df-45e1-a0d5-4b7ca35dac44 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:11.243149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a06eb8f-3679-43e4-9801-8f978d3258cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:11.243833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06eb8f-3679-43e4-9801-8f978d3258cf admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.244235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06eb8f-3679-43e4-9801-8f978d3258cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.244520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a06eb8f-3679-43e4-9801-8f978d3258cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.245260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06eb8f-3679-43e4-9801-8f978d3258cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:11.246865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a06eb8f-3679-43e4-9801-8f978d3258cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.289944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1007/2005] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:11.291204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:11.306140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f3ff5-68a0-4447-82b5-77b67fed26d5 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:11.311029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:11.312313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.312652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.313525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] PATH_INFO: `/v3/projects/67cc59da8e0a40d58aa7329111552833/users/4d80e4f7588141df85848f692749425c/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.316110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67cc59da8e0a40d58aa7329111552833, user_id=4d80e4f7588141df85848f692749425c, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:11.318752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.330658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 999/2006] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:11 2022] PUT /identity/v3/projects/67cc59da8e0a40d58aa7329111552833/users/4d80e4f7588141df85848f692749425c/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:11.344744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78aed9-e360-4209-af08-64133f93a9e8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.345022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78aed9-e360-4209-af08-64133f93a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.345302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78aed9-e360-4209-af08-64133f93a9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.377711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8e78aed9-e360-4209-af08-64133f93a9e8 None None] MFA Rules not processed for user `4d80e4f7588141df85848f692749425c`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:11.379748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e78aed9-e360-4209-af08-64133f93a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:11.466521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1008/2007] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:11.478425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:11.480231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:11.548640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527dcbc4-3ae8-4b7a-950e-bf4ccd55cbc9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:11.553051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8d7cb-3dda-48ec-824f-06a3680afbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:11.553726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d7cb-3dda-48ec-824f-06a3680afbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.554015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d7cb-3dda-48ec-824f-06a3680afbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.554298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8d7cb-3dda-48ec-824f-06a3680afbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.566255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8d7cb-3dda-48ec-824f-06a3680afbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:11.567753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8d7cb-3dda-48ec-824f-06a3680afbf5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.578834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1000/2008] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:11.764280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78aed9-e360-4209-af08-64133f93a9e8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:11.775306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78aed9-e360-4209-af08-64133f93a9e8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:11.779171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:11.779961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:11.780156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:11.780317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:11.840381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:11.841831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:11.851369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1009/2009] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:12.074120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d388-9723-47a6-94a8-a104eeb3faaf None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:12.074615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d388-9723-47a6-94a8-a104eeb3faaf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:12.074709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d388-9723-47a6-94a8-a104eeb3faaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:12.123465 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e486d388-9723-47a6-94a8-a104eeb3faaf None None] MFA Rules not processed for user `842fa4b1c86e4c208ab1f1f119d3bdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:12.124738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e486d388-9723-47a6-94a8-a104eeb3faaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:12.204512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1001/2010] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:12.218347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:12.231094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f13c9-51c9-406f-874e-d393413aa348 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:12.231290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:12.231931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:12.232216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:12.232496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:12.241302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:12.242905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:12.252496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1010/2011] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:13.974328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e074d-eab9-4305-951b-f333b84927e9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:13.974792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e074d-eab9-4305-951b-f333b84927e9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:13.974988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e074d-eab9-4305-951b-f333b84927e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:13.994294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-726e074d-eab9-4305-951b-f333b84927e9 None None] MFA Rules not processed for user `842fa4b1c86e4c208ab1f1f119d3bdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:13.995571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-726e074d-eab9-4305-951b-f333b84927e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:14.006958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1002/2012] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:20.396735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:20.398242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:20.467272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eeb9c-d616-4b5b-9284-b50c88ca3c7d service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:20.472761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:20.473637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:20.473921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:20.474203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] PATH_INFO: `/v3/users/e386aa480b844434bc0ffd304ce27abb` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:20.475453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e386aa480b844434bc0ffd304ce27abb)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:20.477400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:20.724147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e386aa480b844434bc0ffd304ce27abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:20.731018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e386aa480b844434bc0ffd304ce27abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:20.842294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e386aa480b844434bc0ffd304ce27abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:20.870739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e386aa480b844434bc0ffd304ce27abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:20.871722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e386aa480b844434bc0ffd304ce27abb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:20.879242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1011/2013] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:20 2022] DELETE /identity/v3/users/e386aa480b844434bc0ffd304ce27abb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:20.883470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:20.883977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:20.884058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:20.920423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:20.921706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:20.989502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1003/2014] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:21.001420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:21.002976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:21.062203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4e9f8-f32b-49e1-9c90-2dc73685b179 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:21.066178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:21.066829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:21.067115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:21.067430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:21.076996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:21.078430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:21.088672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1012/2015] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:22.027089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:22.028534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:22.041743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a639324-05ac-4f2a-896b-14a201a7aeef None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:22.047076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:22.048674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:22.050138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:22.050617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] PATH_INFO: `/v3/projects/70c243fd4e4c47beb7f6c226abe8d51d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:22.052267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c243fd4e4c47beb7f6c226abe8d51d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:22.056071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:22.196376 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c243fd4e4c47beb7f6c226abe8d51d', 'request_id': 'req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.201856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c243fd4e4c47beb7f6c226abe8d51d', 'request_id': 'req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.209298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c243fd4e4c47beb7f6c226abe8d51d', 'request_id': 'req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.291244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] The token cache is being invalidate because project 70c243fd4e4c47beb7f6c226abe8d51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:22.291541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.292213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.293775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1004/2016] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:22 2022] DELETE /identity/v3/projects/70c243fd4e4c47beb7f6c226abe8d51d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:22.297709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:22.321792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f03e0-bd76-47b8-a4ce-66c1a2e0f4b5 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:22.393418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:22.394309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:22.394596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:22.394876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] PATH_INFO: `/v3/users/047dc3f144d0470da63568e15f26dc88` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:22.396279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] RBAC: Authorizing `identity:delete_user(user_id=047dc3f144d0470da63568e15f26dc88)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:22.398226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:22.624332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047dc3f144d0470da63568e15f26dc88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.632097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047dc3f144d0470da63568e15f26dc88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.693791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047dc3f144d0470da63568e15f26dc88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.706672 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047dc3f144d0470da63568e15f26dc88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.707334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d09b151-3a6d-42bf-a0ae-f65b0455334f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047dc3f144d0470da63568e15f26dc88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:22.713255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1013/2017] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:22 2022] DELETE /identity/v3/users/047dc3f144d0470da63568e15f26dc88 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:23.144774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:23.146223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:23.160199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1abb6-d86b-4fbe-a86c-fb9f2ddd8c51 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:23.236147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:23.237533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:23.237814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:23.238090 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] PATH_INFO: `/v3/projects/1f05c391a9d7480eadfd13908ac7ba56` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:23.239395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f05c391a9d7480eadfd13908ac7ba56)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:23.241291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:23.419890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f05c391a9d7480eadfd13908ac7ba56', 'request_id': 'req-089eb3df-41ea-486c-bc17-0db8417ebfc1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:23.426326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f05c391a9d7480eadfd13908ac7ba56', 'request_id': 'req-089eb3df-41ea-486c-bc17-0db8417ebfc1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:23.433586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f05c391a9d7480eadfd13908ac7ba56', 'request_id': 'req-089eb3df-41ea-486c-bc17-0db8417ebfc1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:23.557330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] The token cache is being invalidate because project 1f05c391a9d7480eadfd13908ac7ba56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:23.557330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:23.557330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-089eb3df-41ea-486c-bc17-0db8417ebfc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:23.559229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1005/2018] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:23 2022] DELETE /identity/v3/projects/1f05c391a9d7480eadfd13908ac7ba56 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:23.564893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b726635-00fe-49d5-81da-a0866ffd1cec None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:23.565552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b726635-00fe-49d5-81da-a0866ffd1cec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:23.565552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b726635-00fe-49d5-81da-a0866ffd1cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:23.583917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8b726635-00fe-49d5-81da-a0866ffd1cec None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:23.585148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8b726635-00fe-49d5-81da-a0866ffd1cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:23.650820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1014/2019] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:23.660929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e4a8-d303-4510-9830-2cce47e4c76f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:23.661219 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e4a8-d303-4510-9830-2cce47e4c76f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:23.661522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e4a8-d303-4510-9830-2cce47e4c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:23.686569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b983e4a8-d303-4510-9830-2cce47e4c76f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:23.687881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b983e4a8-d303-4510-9830-2cce47e4c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:23.696545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1006/2020] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:23.703002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b726635-00fe-49d5-81da-a0866ffd1cec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:23.715825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b726635-00fe-49d5-81da-a0866ffd1cec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:23.721778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:23.729448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:23.729448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:23.729448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:23.729448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:23.729448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:23.729448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:23.741615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1015/2021] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:10:23.742464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e4a8-d303-4510-9830-2cce47e4c76f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:23.752729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e4a8-d303-4510-9830-2cce47e4c76f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:23.757507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:23.758170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:23.758457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:23.758737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:23.759464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:23.761539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:23.881538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:23.883269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:23.896879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a7741-676e-4089-ada0-cc945ccdb1e9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:23.901226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1007/2022] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:23 2022] POST /identity/v3/projects => generated 359 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:23.905224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:23.905224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:23.905224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:23.905224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] PATH_INFO: `/v3/users/fce23710f7694456b5866be242da4882` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:23.905706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fce23710f7694456b5866be242da4882)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:23.907675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:23.908736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:23.971794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916194e4-9500-4f9c-b193-853697c638da admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:23.976502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:23.977165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:23.977451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:23.977729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:23.978443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:23.980385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:24.088760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1008/2023] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:23 2022] POST /identity/v3/users => generated 280 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:24.092674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:24.102966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7efe01-a25b-4d14-8a12-8376edffd69f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:24.108094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:24.108865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.109068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.109367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.110104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:24.112238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:24.113698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fce23710f7694456b5866be242da4882'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.121130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fce23710f7694456b5866be242da4882'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.122968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1009/2024] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:24.126763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:24.136657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c684b9-ed25-400d-958f-2e1d03c6d9d8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:24.141271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:24.141907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.142192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.142473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.143793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:24.145379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:24.155662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1010/2025] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:24.160533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:24.170578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a632d01-bc8b-4e81-8d47-7700c8678315 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:24.175392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6649dc3-b84a-4300-aed4-c21f8e2da97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:24.177948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6649dc3-b84a-4300-aed4-c21f8e2da97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.177948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6649dc3-b84a-4300-aed4-c21f8e2da97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.177948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6649dc3-b84a-4300-aed4-c21f8e2da97c admin admin] PATH_INFO: `/v3/projects/cc2991d2cfd24c0fb168632b291cf8d3/users/cc06b131616b48d68d27929b8ddb1fb7/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.193037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6649dc3-b84a-4300-aed4-c21f8e2da97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2991d2cfd24c0fb168632b291cf8d3, user_id=cc06b131616b48d68d27929b8ddb1fb7, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:24.195778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6649dc3-b84a-4300-aed4-c21f8e2da97c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:24.196635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fce23710f7694456b5866be242da4882'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.209962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fce23710f7694456b5866be242da4882'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.212279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-30b8782e-0613-4ff5-a652-9a7b34e84848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fce23710f7694456b5866be242da4882'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.216651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1016/2026] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:23 2022] DELETE /identity/v3/users/fce23710f7694456b5866be242da4882 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:24.221988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.221988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.222253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.239452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:24.240906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:24.294287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1011/2027] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:24 2022] PUT /identity/v3/projects/cc2991d2cfd24c0fb168632b291cf8d3/users/cc06b131616b48d68d27929b8ddb1fb7/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:24.300988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1017/2028] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:24.307546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.307836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.308114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.312743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:24.314198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:24.335186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] MFA Rules not processed for user `cc06b131616b48d68d27929b8ddb1fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:24.336383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:24.373878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdb17b4-fe83-434d-8915-548301a78a9e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:24.415964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1012/2029] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:24.435980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:24.436997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.437248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.437529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.453841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:24.455330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:24.520747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:24.522219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:24.526167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d71345-43c8-4cff-99da-65429a2ca51d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:24.529958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847ed6a-7cda-4d8b-a831-3544bb011767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:24.530609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ed6a-7cda-4d8b-a831-3544bb011767 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.537433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ed6a-7cda-4d8b-a831-3544bb011767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.537433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ed6a-7cda-4d8b-a831-3544bb011767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.538093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1018/2030] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:10:24.540808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847ed6a-7cda-4d8b-a831-3544bb011767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:24.542283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847ed6a-7cda-4d8b-a831-3544bb011767 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:24.552151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1013/2031] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:24 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:10:24.566675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:24.568158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:24.581714 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c40374-6fa8-48c7-98c2-6756b4cc0bb6 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:24.586374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:24.587357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.587634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.587911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] PATH_INFO: `/v3/users/cc06b131616b48d68d27929b8ddb1fb7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.589196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc06b131616b48d68d27929b8ddb1fb7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:24.591139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:24.793855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc06b131616b48d68d27929b8ddb1fb7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.802375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc06b131616b48d68d27929b8ddb1fb7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.894950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc06b131616b48d68d27929b8ddb1fb7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.907624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc06b131616b48d68d27929b8ddb1fb7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.909023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc06b131616b48d68d27929b8ddb1fb7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:24.916044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1019/2032] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:24 2022] DELETE /identity/v3/users/cc06b131616b48d68d27929b8ddb1fb7 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:24.920806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:24.921404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:24.921693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:24.942882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:24.944238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:24.992367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:24.997486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:25.008608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1014/2033] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:25.029366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:25.030957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:25.068314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa80b66-d8c2-40c0-9dc9-16fb90d2397b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:25.072819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:25.073791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:25.074070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:25.074362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] PATH_INFO: `/v3/projects/57a4fd3197054716b37d90b04d2bd3fc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:25.075691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a4fd3197054716b37d90b04d2bd3fc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:25.077588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:25.088818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8bb0-8dc0-4df3-86a8-f5ee51737ebf None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:25.092532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:25.093182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:25.093481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:25.093761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:25.103389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:25.104824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:25.115076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1015/2034] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:10:25.220208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a4fd3197054716b37d90b04d2bd3fc', 'request_id': 'req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.303055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a4fd3197054716b37d90b04d2bd3fc', 'request_id': 'req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.310216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a4fd3197054716b37d90b04d2bd3fc', 'request_id': 'req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.323162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] The token cache is being invalidate because project 57a4fd3197054716b37d90b04d2bd3fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:25.323479 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.324158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.326002 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1020/2035] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:24 2022] DELETE /identity/v3/projects/57a4fd3197054716b37d90b04d2bd3fc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:25.330218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:25.344024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e41385-4d4b-4f6f-be67-562601376b31 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:25.404436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:25.405482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:25.405835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:25.406185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] PATH_INFO: `/v3/users/4d80e4f7588141df85848f692749425c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:25.407595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d80e4f7588141df85848f692749425c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:25.410844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:25.564056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:25.565978 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:25.580980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2538d-cbe5-444c-91dd-b76d86d81fdd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:25.585869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:25.586864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:25.587170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:25.587459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] PATH_INFO: `/v3/projects/cc2991d2cfd24c0fb168632b291cf8d3` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:25.588994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2991d2cfd24c0fb168632b291cf8d3)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:25.590999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:25.619318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d80e4f7588141df85848f692749425c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.697981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d80e4f7588141df85848f692749425c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.711618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d80e4f7588141df85848f692749425c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.712380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d80e4f7588141df85848f692749425c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.715472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2991d2cfd24c0fb168632b291cf8d3', 'request_id': 'req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.719774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-44f008ed-35ec-4f2b-9d79-b0d5f5713efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d80e4f7588141df85848f692749425c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.726226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1016/2036] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:25 2022] DELETE /identity/v3/users/4d80e4f7588141df85848f692749425c => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:25.812448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2991d2cfd24c0fb168632b291cf8d3', 'request_id': 'req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.819477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2991d2cfd24c0fb168632b291cf8d3', 'request_id': 'req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.830906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] The token cache is being invalidate because project cc2991d2cfd24c0fb168632b291cf8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:25.831110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.831803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-75d1b9a6-6bf4-488d-bde3-1bd880f5408c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:25.833385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1021/2037] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:25 2022] DELETE /identity/v3/projects/cc2991d2cfd24c0fb168632b291cf8d3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:25.838347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77238f2-a3d2-4e51-a1d8-76a72c2dcfc0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:25.842851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77238f2-a3d2-4e51-a1d8-76a72c2dcfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:25.843276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77238f2-a3d2-4e51-a1d8-76a72c2dcfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:25.861943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c77238f2-a3d2-4e51-a1d8-76a72c2dcfc0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:25.863296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c77238f2-a3d2-4e51-a1d8-76a72c2dcfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:25.927390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1017/2038] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:25.935996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273214a8-8f7f-47de-b453-415667053d57 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:25.936294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273214a8-8f7f-47de-b453-415667053d57 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:25.936834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273214a8-8f7f-47de-b453-415667053d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:25.959619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-273214a8-8f7f-47de-b453-415667053d57 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:25.960925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-273214a8-8f7f-47de-b453-415667053d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:25.972872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1022/2039] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:25.977310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77238f2-a3d2-4e51-a1d8-76a72c2dcfc0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:25.989434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77238f2-a3d2-4e51-a1d8-76a72c2dcfc0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:25.999716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.000470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.000693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.000969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.001709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:26.002792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.004463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.019177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1018/2040] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:10:26.021794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273214a8-8f7f-47de-b453-415667053d57 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.032368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273214a8-8f7f-47de-b453-415667053d57 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.040186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.041518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.041518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.041734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.042352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.044638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.136024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1023/2041] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:26.140373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.150645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5615260-850a-45d4-a31f-e51dcb52d7de admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.161193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.163019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:26.223725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.224514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.224980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.225289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.226323 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.228394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.238198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b7117a-9660-42ae-8d08-329617229a41 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.242950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.243868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.244151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.244427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] PATH_INFO: `/v3/projects/67cc59da8e0a40d58aa7329111552833` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.245599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67cc59da8e0a40d58aa7329111552833)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.247600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.316081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1019/2042] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:26.320157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.329601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a01f0c-67e8-484b-8999-2c678de73de6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.335000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.335672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.335959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.336242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.337076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.338672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.352437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1020/2043] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:26.353490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.355595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67cc59da8e0a40d58aa7329111552833', 'request_id': 'req-7eaa55c0-d205-48d9-99a7-52e0405f907e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:26.363747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6122-241a-4d10-be7b-6c14937a362c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.413388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67cc59da8e0a40d58aa7329111552833', 'request_id': 'req-7eaa55c0-d205-48d9-99a7-52e0405f907e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:26.419890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67cc59da8e0a40d58aa7329111552833', 'request_id': 'req-7eaa55c0-d205-48d9-99a7-52e0405f907e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:26.421574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.422254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.422542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.422820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.423608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.425846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.431998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] The token cache is being invalidate because project 67cc59da8e0a40d58aa7329111552833 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:26.432290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:26.432959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7eaa55c0-d205-48d9-99a7-52e0405f907e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:26.434743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1024/2044] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:26 2022] DELETE /identity/v3/projects/67cc59da8e0a40d58aa7329111552833 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:26.442768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1021/2045] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:26.442930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca037712-33f1-49a9-9e2d-9d86c0043925 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.443041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca037712-33f1-49a9-9e2d-9d86c0043925 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.443355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca037712-33f1-49a9-9e2d-9d86c0043925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.443890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.445631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:26.458560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b5911-f163-49ce-ae11-37acea411f6f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.464021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf4a8d-66d4-4cec-b00f-595e8d15d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.464924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf4a8d-66d4-4cec-b00f-595e8d15d3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.465208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf4a8d-66d4-4cec-b00f-595e8d15d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.465482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf4a8d-66d4-4cec-b00f-595e8d15d3ef admin admin] PATH_INFO: `/v3/projects/d272a47a94e4447c86f348d1b24596a0/users/f218191d5fac4c568d3b3d65e6534327/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.467539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ca037712-33f1-49a9-9e2d-9d86c0043925 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:26.468928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ca037712-33f1-49a9-9e2d-9d86c0043925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:26.477150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1025/2046] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:26.481469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf4a8d-66d4-4cec-b00f-595e8d15d3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d272a47a94e4447c86f348d1b24596a0, user_id=f218191d5fac4c568d3b3d65e6534327, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.484174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf4a8d-66d4-4cec-b00f-595e8d15d3ef admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.485248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83071a2b-b200-47bf-98ca-97420653bfc8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.485534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83071a2b-b200-47bf-98ca-97420653bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.485813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83071a2b-b200-47bf-98ca-97420653bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.505744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-83071a2b-b200-47bf-98ca-97420653bfc8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:26.506947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-83071a2b-b200-47bf-98ca-97420653bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:26.515279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1026/2047] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:26.520730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83071a2b-b200-47bf-98ca-97420653bfc8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.529881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83071a2b-b200-47bf-98ca-97420653bfc8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.535415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.536123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.536411 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.536714 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.537526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:26.537756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.539392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.551497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1027/2048] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:10:26.555655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.563961 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1022/2049] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:26 2022] PUT /identity/v3/projects/d272a47a94e4447c86f348d1b24596a0/users/f218191d5fac4c568d3b3d65e6534327/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:26.568935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603646b0-ef08-4758-82bb-1df7186514ba admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.574966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f7b8f-d4c6-4569-97a0-7a04446d8b4a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.575314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f7b8f-d4c6-4569-97a0-7a04446d8b4a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.576041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f7b8f-d4c6-4569-97a0-7a04446d8b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.613824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-568f7b8f-d4c6-4569-97a0-7a04446d8b4a None None] MFA Rules not processed for user `f218191d5fac4c568d3b3d65e6534327`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:26.613824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-568f7b8f-d4c6-4569-97a0-7a04446d8b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:26.630293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.630961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.631283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.631568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.637497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.637497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.678279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1023/2050] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:26.682725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f7b8f-d4c6-4569-97a0-7a04446d8b4a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.694600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f7b8f-d4c6-4569-97a0-7a04446d8b4a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.699327 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.699981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.700264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.700537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.701334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.703231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.736052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1028/2051] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/projects => generated 367 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:26.741347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.809646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd8807-4d78-4e95-bbc0-5dc0d4fc7e07 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.813938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1024/2052] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:26.814600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.883584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5e23e-f721-4841-b0f0-930e463fb897 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.885109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.885795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.886078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.886350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.887266 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.888761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.889351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.889478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.889696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.889971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.890686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.892693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.968428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1029/2053] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/users => generated 284 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:26.973174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.979883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1025/2054] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:26 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:26.983706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:26.988351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3497256-56b2-433b-a3ea-26802bd76598 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.993012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.993666 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.993947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:26.994193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5552c00b-bb2b-49b3-99b4-389a8d3999e1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:26.994309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:26.994933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:26.996575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:26.998759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:26.999437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:26.999751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.000030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.000767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.002509 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.010639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1030/2055] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:27.011597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:27.018578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1026/2056] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:27.020725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:27.022691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec9a52-a02a-4c3c-b7cf-cfcc40130d22 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:27.027394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:27.028053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.028332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.028615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.029517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.031092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.035282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d7a905-3ecb-4078-b74d-f96628d60d8d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:27.041806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:27.042836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.043298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.043580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] PATH_INFO: `/v3/projects/d5569f7dad314626a97ace5ef2c5c1d4/users/e0d2e06276d84bb1b324d2cb2ba95fdc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.045056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1031/2057] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:27.054727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:27.061138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7750b-c19c-4480-af12-97268c79bf43 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:27.066288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ee03-72ec-40e6-942d-5504fd681396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:27.067195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ee03-72ec-40e6-942d-5504fd681396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.067481 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ee03-72ec-40e6-942d-5504fd681396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.067752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ee03-72ec-40e6-942d-5504fd681396 admin admin] PATH_INFO: `/v3/projects/ee008ddb22284ea09956730593b22bb9/users/476d4fb391e64f7e9a850638616e08d2/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.067855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5569f7dad314626a97ace5ef2c5c1d4, user_id=e0d2e06276d84bb1b324d2cb2ba95fdc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.070429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.087963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ee03-72ec-40e6-942d-5504fd681396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee008ddb22284ea09956730593b22bb9, user_id=476d4fb391e64f7e9a850638616e08d2, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.090668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ee03-72ec-40e6-942d-5504fd681396 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.134665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1027/2058] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:27 2022] PUT /identity/v3/projects/d5569f7dad314626a97ace5ef2c5c1d4/users/e0d2e06276d84bb1b324d2cb2ba95fdc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:27.138383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:27.164596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1032/2059] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:27 2022] PUT /identity/v3/projects/ee008ddb22284ea09956730593b22bb9/users/476d4fb391e64f7e9a850638616e08d2/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:27.176619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.176914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.177208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.206640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e68fde-b0f0-478e-9ade-4c873e8d1e94 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:27.220581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] MFA Rules not processed for user `476d4fb391e64f7e9a850638616e08d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:27.222722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:27.265843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:27.266863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.267178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.267461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.268946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.270487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.281929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1028/2060] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:10:27.286399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:27.294411 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1033/2061] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:10:27.296160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41278e-7adc-45ef-bd0c-c9b4e60d5bf7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:27.301591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654dea-5e62-4fc2-98e6-2b57f33bf171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:27.302472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654dea-5e62-4fc2-98e6-2b57f33bf171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.302752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654dea-5e62-4fc2-98e6-2b57f33bf171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.303022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654dea-5e62-4fc2-98e6-2b57f33bf171 admin admin] PATH_INFO: `/v3/projects/d5569f7dad314626a97ace5ef2c5c1d4/users/e0d2e06276d84bb1b324d2cb2ba95fdc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.305016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654dea-5e62-4fc2-98e6-2b57f33bf171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5569f7dad314626a97ace5ef2c5c1d4, user_id=e0d2e06276d84bb1b324d2cb2ba95fdc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.306816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:27.307765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654dea-5e62-4fc2-98e6-2b57f33bf171 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.308209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:27.334365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1029/2062] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:27 2022] PUT /identity/v3/projects/d5569f7dad314626a97ace5ef2c5c1d4/users/e0d2e06276d84bb1b324d2cb2ba95fdc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:10:27.345603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.346530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.346530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.376751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] MFA Rules not processed for user `e0d2e06276d84bb1b324d2cb2ba95fdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:27.378699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:27.384415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d9b49-8c3f-4c00-8bfa-9f7c045f8ca4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:27.436003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f37dda98124a8c8cf4406d985933f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:27.437023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.437304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.437599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.452091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1030/2063] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:27.463502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:27.464877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:27.494086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.495636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.505294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1034/2064] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:27.524862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b25ab-3230-4f58-b2bf-cf6e7b4eb3ac None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:27.529377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772edf-b0fc-4c11-85a3-1f52e69777ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:27.530017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772edf-b0fc-4c11-85a3-1f52e69777ff service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:27.531336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772edf-b0fc-4c11-85a3-1f52e69777ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:27.531336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772edf-b0fc-4c11-85a3-1f52e69777ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:27.589986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b772edf-b0fc-4c11-85a3-1f52e69777ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:27.591458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b772edf-b0fc-4c11-85a3-1f52e69777ff service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:27.601387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1031/2065] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:10:30.712317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:30.791082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb90bd-6c01-4c00-a4c9-e7d44f1a4504 service glance] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:30.797727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:30.798718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:30.799077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:30.799464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] PATH_INFO: `/v3/users/f218191d5fac4c568d3b3d65e6534327` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:30.801375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f218191d5fac4c568d3b3d65e6534327)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:30.803440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:31.050414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f218191d5fac4c568d3b3d65e6534327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:31.058285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f218191d5fac4c568d3b3d65e6534327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:31.150844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f218191d5fac4c568d3b3d65e6534327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:31.164955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f218191d5fac4c568d3b3d65e6534327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:31.165624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f218191d5fac4c568d3b3d65e6534327'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:31.172286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1035/2066] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:30 2022] DELETE /identity/v3/users/f218191d5fac4c568d3b3d65e6534327 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:31.178034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:31.178562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:31.178990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:31.198178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:31.199421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:31.261135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1032/2067] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:31.271151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:31.272586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:31.331503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96616684-2f64-4525-a0d8-dc905475be4d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:31.335981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:31.336628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:31.336915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:31.337194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:31.346162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:31.347907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:31.357960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1036/2068] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:31.750681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:31.757054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:31.783891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2569d764-78a3-4cee-babc-0594664f4af8 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:31.791497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:31.791497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:31.791497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:31.791497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] PATH_INFO: `/v3/projects/d272a47a94e4447c86f348d1b24596a0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:31.792216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d272a47a94e4447c86f348d1b24596a0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:31.794248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:31.931232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd272a47a94e4447c86f348d1b24596a0', 'request_id': 'req-1b7982ae-2340-4d83-8d15-cd53207a0fb7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:31.937038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd272a47a94e4447c86f348d1b24596a0', 'request_id': 'req-1b7982ae-2340-4d83-8d15-cd53207a0fb7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:31.943364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd272a47a94e4447c86f348d1b24596a0', 'request_id': 'req-1b7982ae-2340-4d83-8d15-cd53207a0fb7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.018844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] The token cache is being invalidate because project d272a47a94e4447c86f348d1b24596a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:32.019532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.022157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.023529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1033/2069] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:31 2022] DELETE /identity/v3/projects/d272a47a94e4447c86f348d1b24596a0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:32.027737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:32.041369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af720ca-3671-44d3-9fcc-9ff112a2ea27 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:32.114888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:32.115946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:32.116238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:32.116519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] PATH_INFO: `/v3/users/e0d2e06276d84bb1b324d2cb2ba95fdc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:32.117799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d2e06276d84bb1b324d2cb2ba95fdc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:32.120476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:32.337629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d2e06276d84bb1b324d2cb2ba95fdc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.344892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d2e06276d84bb1b324d2cb2ba95fdc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.436955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d2e06276d84bb1b324d2cb2ba95fdc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.453054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d2e06276d84bb1b324d2cb2ba95fdc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.453856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e2301af5-1d06-4b37-871c-622c005606ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d2e06276d84bb1b324d2cb2ba95fdc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:32.465684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1037/2070] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:32 2022] DELETE /identity/v3/users/e0d2e06276d84bb1b324d2cb2ba95fdc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:32.918679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:32.920225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:32.934154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7982ae-2340-4d83-8d15-cd53207a0fb7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:33.004526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:33.005409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.005692 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.005967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] PATH_INFO: `/v3/projects/d5569f7dad314626a97ace5ef2c5c1d4` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.007208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5569f7dad314626a97ace5ef2c5c1d4)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:33.009129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:33.129420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5569f7dad314626a97ace5ef2c5c1d4', 'request_id': 'req-8d569a6d-62e6-4700-939a-3b7769274d53'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:33.135831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5569f7dad314626a97ace5ef2c5c1d4', 'request_id': 'req-8d569a6d-62e6-4700-939a-3b7769274d53'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:33.142401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5569f7dad314626a97ace5ef2c5c1d4', 'request_id': 'req-8d569a6d-62e6-4700-939a-3b7769274d53'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:33.208016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] The token cache is being invalidate because project d5569f7dad314626a97ace5ef2c5c1d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:33.208254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:33.208879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8d569a6d-62e6-4700-939a-3b7769274d53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:33.210429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1034/2071] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:32 2022] DELETE /identity/v3/projects/d5569f7dad314626a97ace5ef2c5c1d4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:33.215332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d051-338d-407f-8f98-ad7ef13be972 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.215852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d051-338d-407f-8f98-ad7ef13be972 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.215949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d051-338d-407f-8f98-ad7ef13be972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.235813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f9c8d051-338d-407f-8f98-ad7ef13be972 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:33.237035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f9c8d051-338d-407f-8f98-ad7ef13be972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:33.305044 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1038/2072] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:33.319852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1c99a-6261-4750-8199-85fa4e91cb20 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.320229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1c99a-6261-4750-8199-85fa4e91cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.320580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1c99a-6261-4750-8199-85fa4e91cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.342205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b4e1c99a-6261-4750-8199-85fa4e91cb20 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:33.343584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b4e1c99a-6261-4750-8199-85fa4e91cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:33.352214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1035/2073] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:33.356257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d051-338d-407f-8f98-ad7ef13be972 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:33.366589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d051-338d-407f-8f98-ad7ef13be972 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:33.371344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:33.372153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.372455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.372736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.373486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:33.373806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:33.375467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:33.389173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1039/2074] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:10:33.393540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1c99a-6261-4750-8199-85fa4e91cb20 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:33.403205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1c99a-6261-4750-8199-85fa4e91cb20 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:33.407788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:33.408436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.408717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.408986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.410303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:33.412335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:33.529933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1036/2075] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:33 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:33.535154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:33.545895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca98ad-bcb1-4d1a-9c9e-af8c1fda1d88 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:33.607064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:33.607770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.608055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.608334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.609176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:33.612380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:33.715809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1040/2076] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:33 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:33.718888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:33.729799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7aa11e-5a3d-4b5b-8986-a167b38915f4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:33.734450 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:33.735095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.735417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.735697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.736428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:33.738617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:33.748800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1037/2077] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:33.752876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:33.762960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6383a8-6721-4e3e-b7ce-2d598d22ce77 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:33.767895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73636163-9aab-4060-b84b-353463f3d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:33.768543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636163-9aab-4060-b84b-353463f3d645 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.768827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636163-9aab-4060-b84b-353463f3d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.769435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73636163-9aab-4060-b84b-353463f3d645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.770263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73636163-9aab-4060-b84b-353463f3d645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:33.771893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73636163-9aab-4060-b84b-353463f3d645 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:33.782387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1041/2078] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:33.787157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:33.797294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b730d-3eac-4387-a1c1-fd8acdb448d1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:33.802979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:33.803883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.804167 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.804444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] PATH_INFO: `/v3/projects/cdda59eab7384e89b971e2378d2d1397/users/d60a202c34c9497da2e4b7be1f0f33cf/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.818958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdda59eab7384e89b971e2378d2d1397, user_id=d60a202c34c9497da2e4b7be1f0f33cf, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:33.821638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:33.900459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1038/2079] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:33 2022] PUT /identity/v3/projects/cdda59eab7384e89b971e2378d2d1397/users/d60a202c34c9497da2e4b7be1f0f33cf/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:33.911683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd661a-8b1e-475a-808c-8987b9d869f2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:33.911975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd661a-8b1e-475a-808c-8987b9d869f2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:33.912256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd661a-8b1e-475a-808c-8987b9d869f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:33.938264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-68bd661a-8b1e-475a-808c-8987b9d869f2 None None] MFA Rules not processed for user `d60a202c34c9497da2e4b7be1f0f33cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:33.939619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-68bd661a-8b1e-475a-808c-8987b9d869f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:34.006151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1042/2080] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:34.017742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:34.020045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:34.081953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4f7c-e5d2-497d-90e7-8145e32625a7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:34.085776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:34.086417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:34.086694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:34.086968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:34.095506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:34.101490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:34.106422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1039/2081] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:35.826079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1a54-b5f0-4545-956c-65a8bc87e37d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:35.826685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1a54-b5f0-4545-956c-65a8bc87e37d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:35.826685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1a54-b5f0-4545-956c-65a8bc87e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:35.845438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cfaf1a54-b5f0-4545-956c-65a8bc87e37d None None] MFA Rules not processed for user `d60a202c34c9497da2e4b7be1f0f33cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:35.846669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cfaf1a54-b5f0-4545-956c-65a8bc87e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:35.853769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1043/2082] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:37.285818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:37.287255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:37.351636 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37322bf8-d058-4c7b-b687-476ee240fdcb service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:37.356449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:37.358351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:37.358351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:37.358351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] PATH_INFO: `/v3/users/2f47a752ed3345efb76eb9315542ef60` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:37.359094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f47a752ed3345efb76eb9315542ef60)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:37.361053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:37.529866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f47a752ed3345efb76eb9315542ef60'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:37.579253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f47a752ed3345efb76eb9315542ef60'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:37.591472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f47a752ed3345efb76eb9315542ef60'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:37.592118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f47a752ed3345efb76eb9315542ef60'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:37.598851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f47a752ed3345efb76eb9315542ef60'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:37.605104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1040/2083] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:37 2022] DELETE /identity/v3/users/2f47a752ed3345efb76eb9315542ef60 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:37.609579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:37.610038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:37.610154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:37.629220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:37.630420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:37.688485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1044/2084] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:37.699419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:37.700865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:37.759456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6416c-b3d8-433a-8da1-cf0edb5a1489 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:37.765788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e784c0-5077-405d-8643-af9ebe5d2df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:37.765788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e784c0-5077-405d-8643-af9ebe5d2df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:37.765788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e784c0-5077-405d-8643-af9ebe5d2df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:37.765788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e784c0-5077-405d-8643-af9ebe5d2df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:37.774031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e784c0-5077-405d-8643-af9ebe5d2df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:37.775584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e784c0-5077-405d-8643-af9ebe5d2df4 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:37.785727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1041/2085] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:38.215569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:38.216973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:38.229991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6a691-154e-4f4e-bfb7-eecd0e660ec3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:38.235259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:38.236612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.236612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.236857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] PATH_INFO: `/v3/projects/4cc31f15952547f0a886f18616f009f5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.238091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc31f15952547f0a886f18616f009f5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:38.240072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:38.345742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc31f15952547f0a886f18616f009f5', 'request_id': 'req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:38.436833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc31f15952547f0a886f18616f009f5', 'request_id': 'req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:38.442816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc31f15952547f0a886f18616f009f5', 'request_id': 'req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:38.455422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] The token cache is being invalidate because project 4cc31f15952547f0a886f18616f009f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:38.455718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:38.456368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-2d36349b-b8a0-4edd-89ae-02dfb3b487f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:38.458520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1045/2086] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:38 2022] DELETE /identity/v3/projects/4cc31f15952547f0a886f18616f009f5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:38.463039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c73e29-e0e7-4cab-9900-4ad50b1cda05 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.463537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c73e29-e0e7-4cab-9900-4ad50b1cda05 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.463669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c73e29-e0e7-4cab-9900-4ad50b1cda05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.481329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b9c73e29-e0e7-4cab-9900-4ad50b1cda05 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:38.482528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b9c73e29-e0e7-4cab-9900-4ad50b1cda05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:38.540825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1042/2087] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:38.548622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa2ba-ed83-411f-9f28-27095ea88cf3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.548918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa2ba-ed83-411f-9f28-27095ea88cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.549233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362fa2ba-ed83-411f-9f28-27095ea88cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.570592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-362fa2ba-ed83-411f-9f28-27095ea88cf3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:38.571849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-362fa2ba-ed83-411f-9f28-27095ea88cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:38.580083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1046/2088] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:38.584315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c73e29-e0e7-4cab-9900-4ad50b1cda05 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:38.594138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c73e29-e0e7-4cab-9900-4ad50b1cda05 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:38.598844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:38.599534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.599847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.600150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.601454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:10:38.601783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:38.603433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:38.614997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1043/2089] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:10:38.620565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fa2ba-ed83-411f-9f28-27095ea88cf3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:38.629768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362fa2ba-ed83-411f-9f28-27095ea88cf3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:38.634540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:38.635226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.635514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.635793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.636527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:38.638444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:38.718327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1047/2090] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:10:38 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:10:38.722508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:38.734517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e6468-6f43-4171-b277-e52696c4ac57 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:38.791438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:38.792117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.792419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.792692 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.793409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:38.795361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:38.871907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1044/2091] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:10:38 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:10:38.876070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:38.887035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62d31e-a3a1-43e2-b783-b0803f4fb1b0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:38.891595 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:38.892261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.892540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.892818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.893539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:38.895173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:38.906269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1048/2092] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:38.910183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:38.921170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6703ce-3006-45b0-bdcd-544018a1c86c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:38.925834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b00ac1-9f82-4b03-86f9-5fffa1d8905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:38.926596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b00ac1-9f82-4b03-86f9-5fffa1d8905d admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.926779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b00ac1-9f82-4b03-86f9-5fffa1d8905d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.927059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b00ac1-9f82-4b03-86f9-5fffa1d8905d admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.927832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b00ac1-9f82-4b03-86f9-5fffa1d8905d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:38.930291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b00ac1-9f82-4b03-86f9-5fffa1d8905d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:38.941968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1045/2093] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:10:38.945902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:38.961663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348555b2-7f64-4240-b6aa-d1b7f4fc32e4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:38.961937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:38.962823 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:38.963113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:38.963421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] PATH_INFO: `/v3/projects/57febc54d134464eb5df9a9ff4d3dc66/users/99c4d6fd793b466c8a273a2b8d6db0ff/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:38.985448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57febc54d134464eb5df9a9ff4d3dc66, user_id=99c4d6fd793b466c8a273a2b8d6db0ff, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:38.985448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:39.081006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1049/2094] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:10:38 2022] PUT /identity/v3/projects/57febc54d134464eb5df9a9ff4d3dc66/users/99c4d6fd793b466c8a273a2b8d6db0ff/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:39.093861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53853-d008-497a-b2cb-628d42b5de3b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:39.094151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53853-d008-497a-b2cb-628d42b5de3b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:39.094424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f53853-d008-497a-b2cb-628d42b5de3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:39.121605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f0f53853-d008-497a-b2cb-628d42b5de3b None None] MFA Rules not processed for user `99c4d6fd793b466c8a273a2b8d6db0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:39.122815 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f0f53853-d008-497a-b2cb-628d42b5de3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:39.187998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1046/2095] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:39.199483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:39.201187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:39.258931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2e1e8-994e-4019-9ac7-be1d2e006757 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:39.262667 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e0b90-2a13-4084-a3d0-a74dd8974984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:39.263357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0b90-2a13-4084-a3d0-a74dd8974984 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:39.263641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0b90-2a13-4084-a3d0-a74dd8974984 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:39.263917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e0b90-2a13-4084-a3d0-a74dd8974984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:39.272740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e0b90-2a13-4084-a3d0-a74dd8974984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:39.274394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e0b90-2a13-4084-a3d0-a74dd8974984 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:39.283170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1050/2096] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:50.271140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53853-d008-497a-b2cb-628d42b5de3b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:50.338032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f53853-d008-497a-b2cb-628d42b5de3b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:50.346134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:50.347331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:50.347616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:50.347893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] PATH_INFO: `/v3/users/99c4d6fd793b466c8a273a2b8d6db0ff` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:50.349202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c4d6fd793b466c8a273a2b8d6db0ff)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:50.351512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:50.535501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c4d6fd793b466c8a273a2b8d6db0ff'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:50.613315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c4d6fd793b466c8a273a2b8d6db0ff'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:50.626482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c4d6fd793b466c8a273a2b8d6db0ff'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:50.627139 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c4d6fd793b466c8a273a2b8d6db0ff'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:50.633736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c4d6fd793b466c8a273a2b8d6db0ff'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:50.639949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1047/2097] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:10:50 2022] DELETE /identity/v3/users/99c4d6fd793b466c8a273a2b8d6db0ff => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:10:50.644433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:50.644893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:50.644984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:50.662507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:10:50.663782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:50.730584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1051/2098] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:10:50.740171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:50.741719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:50.802622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa64b0-f385-4202-a975-491a9c9fea50 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:50.806392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5965ac-544b-43d4-b9b2-169d95aa8a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:50.807079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5965ac-544b-43d4-b9b2-169d95aa8a9a service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:50.807414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5965ac-544b-43d4-b9b2-169d95aa8a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:50.807690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5965ac-544b-43d4-b9b2-169d95aa8a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:50.818627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5965ac-544b-43d4-b9b2-169d95aa8a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:50.820321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5965ac-544b-43d4-b9b2-169d95aa8a9a service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:50.830632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1048/2099] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:10:51.294897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:10:51.296283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:10:51.309357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a33a-b412-469a-a3e7-392e572b5dc5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:10:51.314690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:10:51.315719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:10:51.316006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:10:51.316285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] PATH_INFO: `/v3/projects/57febc54d134464eb5df9a9ff4d3dc66` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:10:51.317517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57febc54d134464eb5df9a9ff4d3dc66)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:10:51.319482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:10:51.419470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57febc54d134464eb5df9a9ff4d3dc66', 'request_id': 'req-623439c3-5ac5-4c5f-8943-cee2b3175253'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:51.458816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57febc54d134464eb5df9a9ff4d3dc66', 'request_id': 'req-623439c3-5ac5-4c5f-8943-cee2b3175253'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:51.465247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57febc54d134464eb5df9a9ff4d3dc66', 'request_id': 'req-623439c3-5ac5-4c5f-8943-cee2b3175253'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:51.476214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] The token cache is being invalidate because project 57febc54d134464eb5df9a9ff4d3dc66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:10:51.476505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:51.477143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:10:51.478786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1052/2100] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:10:51 2022] DELETE /identity/v3/projects/57febc54d134464eb5df9a9ff4d3dc66 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:06.747076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684777e-e72b-49fb-bd75-7ebe3c8d6910 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:06.748781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684777e-e72b-49fb-bd75-7ebe3c8d6910 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:06.748874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684777e-e72b-49fb-bd75-7ebe3c8d6910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:06.785264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b684777e-e72b-49fb-bd75-7ebe3c8d6910 None None] MFA Rules not processed for user `fe93eb8c93fb4cb4bec6f7cc2c03e1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:06.786525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b684777e-e72b-49fb-bd75-7ebe3c8d6910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:06.881523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1049/2101] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:17.002826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:17.005323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:17.143455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623439c3-5ac5-4c5f-8943-cee2b3175253 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:17.148199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:17.149078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:17.149366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:17.149646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] PATH_INFO: `/v3/users/476d4fb391e64f7e9a850638616e08d2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:17.150870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] RBAC: Authorizing `identity:delete_user(user_id=476d4fb391e64f7e9a850638616e08d2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:17.152882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:17.336577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476d4fb391e64f7e9a850638616e08d2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:17.345516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476d4fb391e64f7e9a850638616e08d2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:17.412727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476d4fb391e64f7e9a850638616e08d2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:17.428297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476d4fb391e64f7e9a850638616e08d2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:17.429113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476d4fb391e64f7e9a850638616e08d2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:17.435926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1053/2102] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:11:17 2022] DELETE /identity/v3/users/476d4fb391e64f7e9a850638616e08d2 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:17.441521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:17.442020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:17.442119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:17.471912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:17.473475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:17.533530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1050/2103] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:17.544135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:17.545598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:17.648554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4eb94-fb7c-4d06-9e35-f8bda3ede04d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:17.648554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916cd71-1916-45db-9ca1-62e95be9255e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:17.648554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916cd71-1916-45db-9ca1-62e95be9255e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:17.648554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916cd71-1916-45db-9ca1-62e95be9255e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:17.648893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916cd71-1916-45db-9ca1-62e95be9255e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:17.657966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916cd71-1916-45db-9ca1-62e95be9255e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:17.659732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916cd71-1916-45db-9ca1-62e95be9255e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:17.670235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1054/2104] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:18.356727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:18.358178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.370588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e7649-e989-4256-8e9f-369603f9bf51 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:18.382011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:18.382899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.383218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.393870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] PATH_INFO: `/v3/projects/ee008ddb22284ea09956730593b22bb9` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.393870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee008ddb22284ea09956730593b22bb9)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:18.393870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:18.401909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.402443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.402443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.433354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:18.434673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.501844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1055/2105] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:11:18.514258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee008ddb22284ea09956730593b22bb9', 'request_id': 'req-deefe155-ea23-41b5-8699-6f307e36c53e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:18.520888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee008ddb22284ea09956730593b22bb9', 'request_id': 'req-deefe155-ea23-41b5-8699-6f307e36c53e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:18.528252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee008ddb22284ea09956730593b22bb9', 'request_id': 'req-deefe155-ea23-41b5-8699-6f307e36c53e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:18.558572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:18.560257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.595882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] The token cache is being invalidate because project ee008ddb22284ea09956730593b22bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:11:18.596418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:18.597196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-deefe155-ea23-41b5-8699-6f307e36c53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:18.609635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1051/2106] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:11:18 2022] DELETE /identity/v3/projects/ee008ddb22284ea09956730593b22bb9 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:18.621588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953ce6c-b8ae-4f83-89a1-40131db4e14f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.621877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953ce6c-b8ae-4f83-89a1-40131db4e14f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.622171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953ce6c-b8ae-4f83-89a1-40131db4e14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.643400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d454cbc-5977-4aab-9914-39b883e70c84 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:18.689319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1953ce6c-b8ae-4f83-89a1-40131db4e14f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:18.690585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1953ce6c-b8ae-4f83-89a1-40131db4e14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.712428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46711ca-4fe8-458c-bac1-49f356c75deb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:18.713338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46711ca-4fe8-458c-bac1-49f356c75deb service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.713626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46711ca-4fe8-458c-bac1-49f356c75deb service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.713933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46711ca-4fe8-458c-bac1-49f356c75deb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.715838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c46711ca-4fe8-458c-bac1-49f356c75deb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.755370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1052/2107] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:11:18.756698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627549-cf67-48df-97c8-6596d4f15038 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.756992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627549-cf67-48df-97c8-6596d4f15038 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.757282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d627549-cf67-48df-97c8-6596d4f15038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.779539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46711ca-4fe8-458c-bac1-49f356c75deb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:18.781799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46711ca-4fe8-458c-bac1-49f356c75deb service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:18.788527 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1d627549-cf67-48df-97c8-6596d4f15038 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:18.789783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1d627549-cf67-48df-97c8-6596d4f15038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.790403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1056/2108] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:11:18.791736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.792176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.792491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.809756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1053/2109] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:18.812594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:18.813955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.824003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1057/2110] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:18.828991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d627549-cf67-48df-97c8-6596d4f15038 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:18.830336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:18.833060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:18.844819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d627549-cf67-48df-97c8-6596d4f15038 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:18.850451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:18.850634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915549f-adee-4cac-b10e-d68fee9ca487 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:18.851153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.851471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.851779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.852526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:11:18.853046 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:18.854733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:18.856019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:18.856800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.857081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.857358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.866503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:18.868292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:18.871169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1054/2111] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:11:18.873058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:18.877581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1058/2112] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:11:18.884576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddcc33-a4d9-488a-b0b7-011a5d339887 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:18.889461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:18.891299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:18.897708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:18.897708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:18.897708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:18.897708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:19.010077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1055/2113] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:11:18 2022] POST /identity/v3/projects => generated 391 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:11:19.014419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:19.026465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a752515-31ab-4fbb-979b-fc4facac7c1b service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:19.175040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:19.175772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.176059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.176341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.177048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:19.179153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:19.270684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1059/2114] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:11:19 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:19.274821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:19.289926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bff17-7640-44b6-ad3f-40715f1c542e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:19.306886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:19.307615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.307908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.308196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.308953 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:19.310661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:19.350024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:19.351069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1056/2115] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:11:19.369297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa6209-43a5-46bb-823c-cdfe0307c49e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:19.385633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb04ce1-51c9-4b9d-8e12-de056b5e3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:19.402083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04ce1-51c9-4b9d-8e12-de056b5e3890 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.402734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04ce1-51c9-4b9d-8e12-de056b5e3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.407756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04ce1-51c9-4b9d-8e12-de056b5e3890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.410614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb04ce1-51c9-4b9d-8e12-de056b5e3890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:19.414442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb04ce1-51c9-4b9d-8e12-de056b5e3890 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:19.450086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1060/2116] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:11:19.451541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:19.475176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af90535-ffd0-40d1-8edc-3171706af462 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:19.492951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:19.494244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.494716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.495181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] PATH_INFO: `/v3/projects/1b6ee29f57c84dce83df5f54efb7f143/users/740890ac70ef41fcab4f1a31122f4c7d/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.523181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6ee29f57c84dce83df5f54efb7f143, user_id=740890ac70ef41fcab4f1a31122f4c7d, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:19.526604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:19.631935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1057/2117] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:11:19 2022] PUT /identity/v3/projects/1b6ee29f57c84dce83df5f54efb7f143/users/740890ac70ef41fcab4f1a31122f4c7d/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:19.643086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868e079-df2d-4b9e-8fb3-b48dbb657faf None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.644178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868e079-df2d-4b9e-8fb3-b48dbb657faf None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.644457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f868e079-df2d-4b9e-8fb3-b48dbb657faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.678900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f868e079-df2d-4b9e-8fb3-b48dbb657faf None None] MFA Rules not processed for user `740890ac70ef41fcab4f1a31122f4c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:19.680610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f868e079-df2d-4b9e-8fb3-b48dbb657faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:19.791298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1061/2118] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:19.800217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:19.801978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:19.879550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230caac0-44c8-4163-b6c8-5a755db8b1c9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:19.884456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:19.885571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.886079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.886579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.899371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:19.903306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:19.903434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61f14-8d0a-4a57-878b-76be8aae9f5a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:19.903434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61f14-8d0a-4a57-878b-76be8aae9f5a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:19.903434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc61f14-8d0a-4a57-878b-76be8aae9f5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:19.918505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1058/2119] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:19.924568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6bc61f14-8d0a-4a57-878b-76be8aae9f5a None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:19.926678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6bc61f14-8d0a-4a57-878b-76be8aae9f5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:20.012603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1062/2120] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 21:11:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:11:20.027247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:20.142818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c55cd13-10e2-47ff-961a-d8cb51fc3249 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:20.162688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:20.162688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:20.162688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:20.162688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:20.206838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:20.234726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:20.247320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1059/2121] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:11:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:11:21.155696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2036-73ec-4adc-a6ea-d412156d5f18 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:21.156734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2036-73ec-4adc-a6ea-d412156d5f18 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:21.157491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2036-73ec-4adc-a6ea-d412156d5f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:21.179678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4a0a2036-73ec-4adc-a6ea-d412156d5f18 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:21.181433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4a0a2036-73ec-4adc-a6ea-d412156d5f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:21.194194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1063/2122] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:11:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:21.208881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:21.221313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1870dcd-984e-4038-a892-7a60f6da73e5 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:21.228718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:21.229816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:21.230166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:21.230459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:21.243896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:21.245698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:21.255753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1060/2123] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:11:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:11:22.046231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681677b-7332-4927-a204-99b380efccea None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:22.046958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681677b-7332-4927-a204-99b380efccea None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:22.047535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681677b-7332-4927-a204-99b380efccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:22.074548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8681677b-7332-4927-a204-99b380efccea None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:22.075986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8681677b-7332-4927-a204-99b380efccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:22.094346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1064/2124] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 21:11:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:22.125250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:22.141849 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4a749-c670-4db7-8c19-8905483c5afb service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:22.157598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834af16e-dbe4-4dfd-983b-806d4ddc5b19 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:22.158297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af16e-dbe4-4dfd-983b-806d4ddc5b19 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:22.158555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af16e-dbe4-4dfd-983b-806d4ddc5b19 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:22.159595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834af16e-dbe4-4dfd-983b-806d4ddc5b19 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:22.179029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834af16e-dbe4-4dfd-983b-806d4ddc5b19 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:22.180762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834af16e-dbe4-4dfd-983b-806d4ddc5b19 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:22.213608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1061/2125] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:11:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:11:37.330768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681677b-7332-4927-a204-99b380efccea None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:37.332306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8681677b-7332-4927-a204-99b380efccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:37.399405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681677b-7332-4927-a204-99b380efccea None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:37.403994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:37.404881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:37.405177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:37.405443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] PATH_INFO: `/v3/users/d60a202c34c9497da2e4b7be1f0f33cf` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:37.406781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60a202c34c9497da2e4b7be1f0f33cf)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:37.408779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:37.615900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60a202c34c9497da2e4b7be1f0f33cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:37.622761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60a202c34c9497da2e4b7be1f0f33cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:37.686447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60a202c34c9497da2e4b7be1f0f33cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:37.699563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60a202c34c9497da2e4b7be1f0f33cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:37.700221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60a202c34c9497da2e4b7be1f0f33cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:37.706165 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1065/2126] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:11:37 2022] DELETE /identity/v3/users/d60a202c34c9497da2e4b7be1f0f33cf => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:37.710767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:37.711343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:37.711343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:37.728250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:37.729426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:37.800128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1062/2127] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:37.810618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:37.812526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:37.871853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3084c9-e456-4aa5-a8aa-52529cf1a076 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:37.875645 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa6a52-1174-4441-b489-d0455198451e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:37.876451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6a52-1174-4441-b489-d0455198451e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:37.876738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6a52-1174-4441-b489-d0455198451e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:37.877019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa6a52-1174-4441-b489-d0455198451e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:37.886341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6a52-1174-4441-b489-d0455198451e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:37.887824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa6a52-1174-4441-b489-d0455198451e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:37.898544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1066/2128] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:38.111352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:38.112781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:38.124945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66c609-ceab-46ab-a725-e3c955db7a76 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:38.130423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:38.131828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.131828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.132043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] PATH_INFO: `/v3/projects/cdda59eab7384e89b971e2378d2d1397` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.133066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdda59eab7384e89b971e2378d2d1397)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:38.135035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:38.230501 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdda59eab7384e89b971e2378d2d1397', 'request_id': 'req-adf99c09-e8ad-4e40-b548-946e9446bea9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:38.237920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdda59eab7384e89b971e2378d2d1397', 'request_id': 'req-adf99c09-e8ad-4e40-b548-946e9446bea9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:38.244805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdda59eab7384e89b971e2378d2d1397', 'request_id': 'req-adf99c09-e8ad-4e40-b548-946e9446bea9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:38.337276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] The token cache is being invalidate because project cdda59eab7384e89b971e2378d2d1397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:11:38.337598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:38.338278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-adf99c09-e8ad-4e40-b548-946e9446bea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:38.339921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1063/2129] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:11:38 2022] DELETE /identity/v3/projects/cdda59eab7384e89b971e2378d2d1397 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:38.346602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485b432-5b89-46ef-87d1-941445afad38 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.347037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485b432-5b89-46ef-87d1-941445afad38 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.347215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485b432-5b89-46ef-87d1-941445afad38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.369861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f485b432-5b89-46ef-87d1-941445afad38 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:38.369861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f485b432-5b89-46ef-87d1-941445afad38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:38.438629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1067/2130] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:38.446423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5272-f513-4414-99fa-0d5ff25d27a1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.446715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5272-f513-4414-99fa-0d5ff25d27a1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.446997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c5272-f513-4414-99fa-0d5ff25d27a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.465512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-993c5272-f513-4414-99fa-0d5ff25d27a1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:38.466717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-993c5272-f513-4414-99fa-0d5ff25d27a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:38.475517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1064/2131] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:38.479611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485b432-5b89-46ef-87d1-941445afad38 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:38.489407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485b432-5b89-46ef-87d1-941445afad38 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:38.494129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:38.494782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.495069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.495572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.496311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:11:38.496622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:38.498235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:38.509942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1068/2132] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:11:38.514099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c5272-f513-4414-99fa-0d5ff25d27a1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:38.523859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c5272-f513-4414-99fa-0d5ff25d27a1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:38.528557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:38.529200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.529508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.529787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.530482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:38.533121 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:38.607700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1065/2133] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:11:38 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:38.611957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:38.621652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb277d-4abd-499a-945b-bf24d760b1e8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:38.678530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:38.679240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.679528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.679799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.680497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:38.682450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:38.759098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1069/2134] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:11:38 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:38.760352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:38.771258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f92fb-ce1d-456e-b2cc-adc1c4e20b01 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:38.776006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:38.776669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.776958 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.777262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.778035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:38.779698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:38.790445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1066/2135] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:11:38.794348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:38.804932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3897bf21-2c91-4b21-b8e6-0ef4c8365154 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:38.814127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf703573-41fc-48a7-a06d-a585fa695b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:38.814990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703573-41fc-48a7-a06d-a585fa695b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.815448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703573-41fc-48a7-a06d-a585fa695b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.815878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf703573-41fc-48a7-a06d-a585fa695b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.816790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf703573-41fc-48a7-a06d-a585fa695b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:38.818572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf703573-41fc-48a7-a06d-a585fa695b87 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:38.829917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1070/2136] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:11:38.833841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:38.844956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446b0fd-0020-4d0a-84c5-d505fb61b3eb admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:38.851311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:38.851311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.851311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.852082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] PATH_INFO: `/v3/projects/fa59d3d177fb4b578fecee910e079117/users/4c4ab23d3e7b4b018d144bea8b98dc24/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.867647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa59d3d177fb4b578fecee910e079117, user_id=4c4ab23d3e7b4b018d144bea8b98dc24, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:38.870221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:38.926901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1067/2137] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:11:38 2022] PUT /identity/v3/projects/fa59d3d177fb4b578fecee910e079117/users/4c4ab23d3e7b4b018d144bea8b98dc24/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:38.931756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e525f-0c79-4b53-bae7-6d1ca9132e5d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:38.932049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e525f-0c79-4b53-bae7-6d1ca9132e5d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:38.932335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e525f-0c79-4b53-bae7-6d1ca9132e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:38.951047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-473e525f-0c79-4b53-bae7-6d1ca9132e5d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:38.952374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-473e525f-0c79-4b53-bae7-6d1ca9132e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:39.016808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1071/2138] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:39.023285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:39.024977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:39.083065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03873017-5d5a-4877-965c-d9533f1aa20e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:39.086722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7de4d3-9a07-455e-a92c-a9514feeb166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:39.087397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7de4d3-9a07-455e-a92c-a9514feeb166 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:39.087688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7de4d3-9a07-455e-a92c-a9514feeb166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:39.087970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7de4d3-9a07-455e-a92c-a9514feeb166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:39.099165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7de4d3-9a07-455e-a92c-a9514feeb166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:39.100226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7de4d3-9a07-455e-a92c-a9514feeb166 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:39.118591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1068/2139] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:43.541137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283871e6-f0bc-4819-90c0-e89aec13ac59 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:43.541669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283871e6-f0bc-4819-90c0-e89aec13ac59 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:43.541835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283871e6-f0bc-4819-90c0-e89aec13ac59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:43.560891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-283871e6-f0bc-4819-90c0-e89aec13ac59 None None] MFA Rules not processed for user `62bc5605a22d408f9b4bac69a0f5f486`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:43.562168 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-283871e6-f0bc-4819-90c0-e89aec13ac59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:43.619801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1072/2140] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:11:46.911405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2b704-cef5-4b75-9646-39c61e1f6ac2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:46.912469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2b704-cef5-4b75-9646-39c61e1f6ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:46.912907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2b704-cef5-4b75-9646-39c61e1f6ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:46.951310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7ed2b704-cef5-4b75-9646-39c61e1f6ac2 None None] MFA Rules not processed for user `4c4ab23d3e7b4b018d144bea8b98dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:46.952912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7ed2b704-cef5-4b75-9646-39c61e1f6ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:47.062164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1069/2141] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:47.066831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283871e6-f0bc-4819-90c0-e89aec13ac59 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:47.083334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283871e6-f0bc-4819-90c0-e89aec13ac59 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:47.093055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:47.096305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:47.097944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:47.098220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:47.109015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:47.115960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:47.229956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1073/2142] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:11:47 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:47.235329 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2b704-cef5-4b75-9646-39c61e1f6ac2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:47.243060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:47.247833 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:47.253321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2b704-cef5-4b75-9646-39c61e1f6ac2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:47.374661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:47.376197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:47.376669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:47.377001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:47.383468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8fd64-4682-42e0-bf2c-6fc24bdccb0c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:47.390111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:47.392490 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:47.395053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:47.395622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] PATH_INFO: `/v3/users/740890ac70ef41fcab4f1a31122f4c7d` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:47.397882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:47.400086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740890ac70ef41fcab4f1a31122f4c7d)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:47.401371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:47.404967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:47.532404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1070/2143] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:11:47 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:47.542586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:47.561074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec70e78-1e0e-4f9b-bc0e-7d4d987a2c7d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:47.575011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:47.576242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:47.576877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:47.577422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:47.579301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:47.581469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:47.596305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1071/2144] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:11:47.604781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:47.627231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cab24-ba05-4cb5-a3d2-a41950267e73 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:47.629949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:47.631019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:47.631476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:47.631921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] PATH_INFO: `/v3/projects/3d3b5d65ba974a51a25579873fe2681f/users/dedc8ab5caae4baca6e967b3c9dc2ccc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:47.657594 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3b5d65ba974a51a25579873fe2681f, user_id=dedc8ab5caae4baca6e967b3c9dc2ccc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:47.666759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:47.684429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740890ac70ef41fcab4f1a31122f4c7d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:47.693919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740890ac70ef41fcab4f1a31122f4c7d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:47.756661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1072/2145] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:11:47 2022] PUT /identity/v3/projects/3d3b5d65ba974a51a25579873fe2681f/users/dedc8ab5caae4baca6e967b3c9dc2ccc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:47.762154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:47.801337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740890ac70ef41fcab4f1a31122f4c7d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:47.866939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740890ac70ef41fcab4f1a31122f4c7d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:47.868334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0270b89b-6f2d-4b67-84a5-9998c4499dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740890ac70ef41fcab4f1a31122f4c7d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:47.884337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1074/2146] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:11:47 2022] DELETE /identity/v3/users/740890ac70ef41fcab4f1a31122f4c7d => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:11:47.891662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:47.892195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:47.893942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:47.919716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:47.921160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:47.967382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b810b-3e77-478f-947f-626d215b05f8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:48.068958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1075/2147] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:48.080010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:48.081742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:48.110687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:48.111488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:48.111770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:48.112189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:48.112943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:48.114604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:48.155839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1073/2148] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:11:48.161842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:48.169984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f49ab0-ff1a-459a-a485-1542479ea1ab None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:48.174002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:48.177605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:48.178284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:48.178549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:48.178825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:48.191177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:48.192668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:48.208572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318d94-8df3-44b1-9168-33461043cce0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:48.216230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1076/2149] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:48.221803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81689f9e-d6ac-4500-ae58-952a84119396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:48.222977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81689f9e-d6ac-4500-ae58-952a84119396 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:48.223491 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81689f9e-d6ac-4500-ae58-952a84119396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:48.223989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81689f9e-d6ac-4500-ae58-952a84119396 admin admin] PATH_INFO: `/v3/projects/3d3b5d65ba974a51a25579873fe2681f/users/dedc8ab5caae4baca6e967b3c9dc2ccc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:48.226571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81689f9e-d6ac-4500-ae58-952a84119396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3b5d65ba974a51a25579873fe2681f, user_id=dedc8ab5caae4baca6e967b3c9dc2ccc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:48.229464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81689f9e-d6ac-4500-ae58-952a84119396 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:48.276079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1074/2150] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:11:48 2022] PUT /identity/v3/projects/3d3b5d65ba974a51a25579873fe2681f/users/dedc8ab5caae4baca6e967b3c9dc2ccc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:11:48.944700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:48.946587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:48.969732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e02d-da2b-4a48-bef8-87b63924289e service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:49.086051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:49.088987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.089378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.089756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] PATH_INFO: `/v3/projects/1b6ee29f57c84dce83df5f54efb7f143` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.099982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6ee29f57c84dce83df5f54efb7f143)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:49.104796 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:49.260176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6ee29f57c84dce83df5f54efb7f143', 'request_id': 'req-594c4794-e4b9-426d-a514-fba7cdbb73a1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:49.355574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6ee29f57c84dce83df5f54efb7f143', 'request_id': 'req-594c4794-e4b9-426d-a514-fba7cdbb73a1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:49.365319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6ee29f57c84dce83df5f54efb7f143', 'request_id': 'req-594c4794-e4b9-426d-a514-fba7cdbb73a1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:49.390313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] The token cache is being invalidate because project 1b6ee29f57c84dce83df5f54efb7f143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:11:49.391053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:49.391970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-594c4794-e4b9-426d-a514-fba7cdbb73a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:11:49.395078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1077/2151] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:11:48 2022] DELETE /identity/v3/projects/1b6ee29f57c84dce83df5f54efb7f143 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:49.410118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1b45-4947-4c9e-9e8e-a2445336d1f9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.410118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1b45-4947-4c9e-9e8e-a2445336d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.410118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc1b45-4947-4c9e-9e8e-a2445336d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.423535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-52fc1b45-4947-4c9e-9e8e-a2445336d1f9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:49.424838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-52fc1b45-4947-4c9e-9e8e-a2445336d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:49.514037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1075/2152] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:49.514999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eabb69-6933-4279-bb8f-1d6095549eee None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.515350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eabb69-6933-4279-bb8f-1d6095549eee None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.516292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eabb69-6933-4279-bb8f-1d6095549eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.596201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-46eabb69-6933-4279-bb8f-1d6095549eee None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:49.597454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-46eabb69-6933-4279-bb8f-1d6095549eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:49.623510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bcca-84bf-4bfb-9187-465e2e9b7f28 None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.623914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bcca-84bf-4bfb-9187-465e2e9b7f28 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.624208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b52bcca-84bf-4bfb-9187-465e2e9b7f28 None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.626693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1076/2153] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:11:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:49.630813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1078/2154] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:49.635787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bcca-84bf-4bfb-9187-465e2e9b7f28 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:49.639764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.640207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.640675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.658862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b52bcca-84bf-4bfb-9187-465e2e9b7f28 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:49.672986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:49.674165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.675763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.677357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.678291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:11:49.680557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:49.686077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:49.712307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1077/2155] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:11:49.716744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:49.739984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc56c2-551c-4da0-8666-b4115a90d465 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:49.750107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:49.751939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:49.763274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:49.763274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:49.763274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:49.763274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:49.764048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:49.764048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:49.873370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1078/2156] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:11:49 2022] POST /identity/v3/projects => generated 399 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:49.874613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:49.915929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1079/2157] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:11:49.924658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:49.935060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:49.997205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64673322-4129-47bf-9ea1-91302a29a747 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:50.003881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:50.004893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.005275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.005634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.006883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:50.009218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:50.094537 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1007a-dc13-4c0a-81e1-45b4a508b263 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:50.212891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528dfdb-3f65-4b9b-8909-422cd5cd1e25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f37dda98124a8c8cf4406d985933f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:50.222810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528dfdb-3f65-4b9b-8909-422cd5cd1e25 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.223109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528dfdb-3f65-4b9b-8909-422cd5cd1e25 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.223417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528dfdb-3f65-4b9b-8909-422cd5cd1e25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.242930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1079/2158] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:11:49 2022] POST /identity/v3/users => generated 300 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:11:50.252499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:50.278350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7927517b-09b8-433a-b040-397932464c6d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:50.288129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:50.288944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.289337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.289716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.290615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:50.292923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:50.321763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1080/2159] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:11:50.330745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:50.355990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e798e-8d10-4327-86a4-30823d09ffb2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:50.371446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:50.372453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.372752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.373096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.373969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:50.378842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:50.397350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528dfdb-3f65-4b9b-8909-422cd5cd1e25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:50.402979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528dfdb-3f65-4b9b-8909-422cd5cd1e25 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:50.403657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1081/2160] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:11:50.405137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:50.457428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1080/2161] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:50.458528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4719a61-227c-41ca-8f93-d83297978c78 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:50.476607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950218cf-263c-484c-8372-b9fe7843d6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:50.477934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950218cf-263c-484c-8372-b9fe7843d6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.478434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950218cf-263c-484c-8372-b9fe7843d6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.478860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950218cf-263c-484c-8372-b9fe7843d6b3 admin admin] PATH_INFO: `/v3/projects/8faf99d4aabb4acfa46c1f8e0c36a4b0/users/58317c670c624b9491b1a1ee6ce744f2/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.544059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950218cf-263c-484c-8372-b9fe7843d6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8faf99d4aabb4acfa46c1f8e0c36a4b0, user_id=58317c670c624b9491b1a1ee6ce744f2, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:50.554356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950218cf-263c-484c-8372-b9fe7843d6b3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:50.688358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1082/2162] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:11:50 2022] PUT /identity/v3/projects/8faf99d4aabb4acfa46c1f8e0c36a4b0/users/58317c670c624b9491b1a1ee6ce744f2/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:11:50.698903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.699205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.699485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.742066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] MFA Rules not processed for user `58317c670c624b9491b1a1ee6ce744f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:50.752410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:50.768492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898250a-b72d-4bf4-8adf-1263a93003ab None None] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.768710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898250a-b72d-4bf4-8adf-1263a93003ab None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.769047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898250a-b72d-4bf4-8adf-1263a93003ab None None] PATH_INFO: `/` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.770473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1083/2163] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:11:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:50.775641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.775936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.776365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.806675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] MFA Rules not processed for user `c298cfd105174cd89ba5ef6eb50b1601`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:50.808268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:50.885110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1084/2164] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:11:50.889206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1081/2165] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:50.910868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:50.920562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:50.932726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:50.934250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:50.961863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e454a-8e45-425c-94bd-b2160ece08a8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:50.980273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa4179-00db-43d1-9916-190c5d65a600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:50.984152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4179-00db-43d1-9916-190c5d65a600 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:50.984152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4179-00db-43d1-9916-190c5d65a600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:50.984152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa4179-00db-43d1-9916-190c5d65a600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:50.998997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa4179-00db-43d1-9916-190c5d65a600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:51.001855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa4179-00db-43d1-9916-190c5d65a600 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:51.016652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1082/2166] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:11:51.037570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90419a8-8bde-41cb-9333-7143c0870274 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:51.042169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a08b7-5c14-4ab9-8085-259df7426207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:51.042840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a08b7-5c14-4ab9-8085-259df7426207 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:51.043154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a08b7-5c14-4ab9-8085-259df7426207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:51.043482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a08b7-5c14-4ab9-8085-259df7426207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:51.054479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a08b7-5c14-4ab9-8085-259df7426207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:51.056074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a08b7-5c14-4ab9-8085-259df7426207 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:51.068219 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1085/2167] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:51.239287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd55ae-1be7-466e-9949-e9240ad3d81d None None] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:51.239830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd55ae-1be7-466e-9949-e9240ad3d81d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:51.239950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd55ae-1be7-466e-9949-e9240ad3d81d None None] PATH_INFO: `/` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:51.241378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1083/2168] 10.222.0.49 () {54 vars in 921 bytes} [Tue May 10 21:11:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 10 21:11:51.248795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0458-fd89-4ce3-96fc-614234f78165 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:51.248795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0458-fd89-4ce3-96fc-614234f78165 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:51.248795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0458-fd89-4ce3-96fc-614234f78165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:51.278611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fb4e0458-fd89-4ce3-96fc-614234f78165 None None] MFA Rules not processed for user `dd4bf9aaaae4483bade1570b1c1cfae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:51.279891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fb4e0458-fd89-4ce3-96fc-614234f78165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:51.377414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1086/2169] 10.222.0.49 () {58 vars in 1018 bytes} [Tue May 10 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:11:51.389472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd55ae-1be7-466e-9949-e9240ad3d81d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:51.400975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd55ae-1be7-466e-9949-e9240ad3d81d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:51.405630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:51.412326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:51.412326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:51.412326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:51.422789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:51.425076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:51.455441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1084/2170] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:56.632351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a41b-a64d-4ab6-8f84-40431783d69e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:56.632924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a41b-a64d-4ab6-8f84-40431783d69e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:56.632924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24a41b-a64d-4ab6-8f84-40431783d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:56.678723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0d24a41b-a64d-4ab6-8f84-40431783d69e None None] MFA Rules not processed for user `dedc8ab5caae4baca6e967b3c9dc2ccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:56.679999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0d24a41b-a64d-4ab6-8f84-40431783d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:56.758728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1087/2171] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:56.772782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:56.774228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:56.789455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7a3e7-2096-4b15-8dd5-7192279e7967 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:56.795030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:56.795736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:56.796030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:56.796307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:56.798368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:56.863979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:56.870033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:56.877494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1085/2172] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:11:59.620416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a17304-1f27-4bc9-9689-d02a4e2fea73 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:59.621307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a17304-1f27-4bc9-9689-d02a4e2fea73 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:59.621771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a17304-1f27-4bc9-9689-d02a4e2fea73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:59.687008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-03a17304-1f27-4bc9-9689-d02a4e2fea73 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:11:59.688824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-03a17304-1f27-4bc9-9689-d02a4e2fea73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:59.786096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1088/2173] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:11:59.800538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:11:59.802699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:11:59.905715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309ad43-4734-4353-9288-883d7bad2b3f service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:11:59.913086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:11:59.913840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:11:59.914188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:11:59.914633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:11:59.926518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:11:59.928316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:11:59.937486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1086/2174] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:12:00.682859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b115-6e4d-48f1-bfce-0ee80819f91e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:00.688416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b115-6e4d-48f1-bfce-0ee80819f91e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:00.688416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b115-6e4d-48f1-bfce-0ee80819f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:00.706790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bc06b115-6e4d-48f1-bfce-0ee80819f91e None None] MFA Rules not processed for user `4c4ab23d3e7b4b018d144bea8b98dc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:00.708156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bc06b115-6e4d-48f1-bfce-0ee80819f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:00.715222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1089/2175] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:03.691613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:03.805910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30f9bd-21da-4291-8180-7a8709c19802 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:03.810457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:03.811412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:03.811692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:03.811965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] PATH_INFO: `/v3/users/58317c670c624b9491b1a1ee6ce744f2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:03.813445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58317c670c624b9491b1a1ee6ce744f2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:03.816043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:04.003750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58317c670c624b9491b1a1ee6ce744f2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:04.013449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58317c670c624b9491b1a1ee6ce744f2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:04.086294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58317c670c624b9491b1a1ee6ce744f2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:04.108465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58317c670c624b9491b1a1ee6ce744f2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:04.109393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58317c670c624b9491b1a1ee6ce744f2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:04.119904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1087/2176] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:12:03 2022] DELETE /identity/v3/users/58317c670c624b9491b1a1ee6ce744f2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:12:04.121793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:04.122302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:04.122541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:04.163730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:04.164989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:04.229546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1090/2177] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:04.242075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:04.243969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:04.340663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efe627-241c-46a8-8afa-f748d75f1d09 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:04.344872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68064814-2560-4a6f-b29e-64e4122defd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:04.345675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064814-2560-4a6f-b29e-64e4122defd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:04.346019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064814-2560-4a6f-b29e-64e4122defd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:04.346932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68064814-2560-4a6f-b29e-64e4122defd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:04.357560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064814-2560-4a6f-b29e-64e4122defd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:04.359320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68064814-2560-4a6f-b29e-64e4122defd0 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:04.374944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1088/2178] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:05.309663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:05.311202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:05.324137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf15a72c-2cc9-449d-b838-621e9e2ada2a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:05.334487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:05.335557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:05.335943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:05.336335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] PATH_INFO: `/v3/projects/8faf99d4aabb4acfa46c1f8e0c36a4b0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:05.337632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8faf99d4aabb4acfa46c1f8e0c36a4b0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:05.339665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:05.488192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8faf99d4aabb4acfa46c1f8e0c36a4b0', 'request_id': 'req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:05.494016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8faf99d4aabb4acfa46c1f8e0c36a4b0', 'request_id': 'req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:05.500837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8faf99d4aabb4acfa46c1f8e0c36a4b0', 'request_id': 'req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:05.577273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] The token cache is being invalidate because project 8faf99d4aabb4acfa46c1f8e0c36a4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:12:05.577631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:05.578330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c0bdf527-cb84-4ebe-a8da-86d26b719f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:12:05.580505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1091/2179] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:12:05 2022] DELETE /identity/v3/projects/8faf99d4aabb4acfa46c1f8e0c36a4b0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:12:05.586024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c07-56d9-401f-8155-dd200b59e462 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:05.586614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c07-56d9-401f-8155-dd200b59e462 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:05.586614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6c07-56d9-401f-8155-dd200b59e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:05.608231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-353b6c07-56d9-401f-8155-dd200b59e462 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:05.609718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-353b6c07-56d9-401f-8155-dd200b59e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:05.701618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1089/2180] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:05.708717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164bb49-df5e-4bb0-afef-903d441df516 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:05.709006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164bb49-df5e-4bb0-afef-903d441df516 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:05.709284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164bb49-df5e-4bb0-afef-903d441df516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:05.730994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a164bb49-df5e-4bb0-afef-903d441df516 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:05.732328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a164bb49-df5e-4bb0-afef-903d441df516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:05.741251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1092/2181] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:05.745674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6c07-56d9-401f-8155-dd200b59e462 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:05.756869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6c07-56d9-401f-8155-dd200b59e462 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:05.761740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:05.762413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:05.762699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:05.762980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:05.763759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:12:05.764067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:05.765701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:05.780751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1090/2182] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:12:05.783432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164bb49-df5e-4bb0-afef-903d441df516 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:05.793745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164bb49-df5e-4bb0-afef-903d441df516 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:05.798965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:05.799921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:05.800339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:05.800709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:05.801522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:05.804381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:05.920049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1093/2183] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:12:05 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:12:05.924325 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:05.934860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6461e36f-9a8c-493f-83c5-7dab45bfce08 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:05.992274 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:05.992996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:05.993285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:05.993713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:05.994576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:05.996987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:06.104991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1091/2184] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:12:05 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:12:06.108933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:06.119028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d560a-3da1-41fe-babd-e8b8d3d38f2d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:06.123779 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:06.130335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:06.130335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:06.130335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:06.130335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:06.130335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:06.137925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1094/2185] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:12:06.142257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:06.154031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c60a26d-3006-48ef-acc2-29fab5352c02 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:06.158760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab8fab-4253-4595-8c5f-7fad550f6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:06.161827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8fab-4253-4595-8c5f-7fad550f6ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:06.162224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8fab-4253-4595-8c5f-7fad550f6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:06.162393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab8fab-4253-4595-8c5f-7fad550f6ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:06.163115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab8fab-4253-4595-8c5f-7fad550f6ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:06.164777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab8fab-4253-4595-8c5f-7fad550f6ce3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:06.175854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1092/2186] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:12:06.179785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:06.189992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4231540a-203c-4889-bcb5-3fc14e5528ea admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:06.195007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:06.195911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:06.196188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:06.196454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] PATH_INFO: `/v3/projects/07437b61b6dc4f70af85bb413e294295/users/1d97010c72384a4e9714e9630397e0e8/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:06.216204 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07437b61b6dc4f70af85bb413e294295, user_id=1d97010c72384a4e9714e9630397e0e8, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:06.219311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:06.309637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1095/2187] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:12:06 2022] PUT /identity/v3/projects/07437b61b6dc4f70af85bb413e294295/users/1d97010c72384a4e9714e9630397e0e8/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:12:06.315920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585904-bc45-4251-8b95-5329e1cd032d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:06.316696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585904-bc45-4251-8b95-5329e1cd032d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:06.316983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35585904-bc45-4251-8b95-5329e1cd032d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:06.334734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-35585904-bc45-4251-8b95-5329e1cd032d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:06.335991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-35585904-bc45-4251-8b95-5329e1cd032d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:06.401350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1093/2188] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:12:06.412558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:06.414540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:06.488802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1130293-9cea-42a4-af1e-8d6d91425694 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:06.493082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:06.493823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:06.494159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:06.494483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:06.505217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:06.507155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:06.517297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1096/2189] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:12:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:09.544649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339a808-327a-4fde-a5f7-d1adc40e3a26 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:09.545542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339a808-327a-4fde-a5f7-d1adc40e3a26 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:09.545972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339a808-327a-4fde-a5f7-d1adc40e3a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:09.590724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b339a808-327a-4fde-a5f7-d1adc40e3a26 None None] MFA Rules not processed for user `842fa4b1c86e4c208ab1f1f119d3bdd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:09.592255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b339a808-327a-4fde-a5f7-d1adc40e3a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:09.666009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1094/2190] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:12:13.769688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:13.771925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:13.825615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976a7c7-bd79-436a-94ea-8eadb0af1b21 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:13.826139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976a7c7-bd79-436a-94ea-8eadb0af1b21 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:13.827093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976a7c7-bd79-436a-94ea-8eadb0af1b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:13.856584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b976a7c7-bd79-436a-94ea-8eadb0af1b21 None None] MFA Rules not processed for user `1d97010c72384a4e9714e9630397e0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:13.861150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b976a7c7-bd79-436a-94ea-8eadb0af1b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:13.888703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3072a-348b-4b20-b734-76de6bd958f2 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:13.898887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:13.899604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:13.901847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:13.902155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:13.905604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:13.926719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:13.927985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:13.944109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1095/2191] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:12:13.945716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1097/2192] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:13.945834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976a7c7-bd79-436a-94ea-8eadb0af1b21 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:13.956901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976a7c7-bd79-436a-94ea-8eadb0af1b21 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:13.969768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:13.969768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:13.969768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:13.969768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:13.970103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:13.970861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:14.078148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1096/2193] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:12:13 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:12:14.080840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:14.091564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a47fc-a20c-4c24-8bfa-72d61aff66d8 service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:14.156825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:14.157507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:14.157797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:14.158078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:14.159925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:14.161805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:14.257389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1098/2194] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:12:14 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:12:14.258853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:14.269840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0060a-6d9b-4f2c-b374-7ac8eee912a5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:14.274659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:14.275383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:14.279843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:14.279843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:14.279843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:14.279843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:14.293365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1097/2195] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:12:14.297613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:14.309461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed3b4d-1296-41b8-bbea-0c1b3d68df47 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:14.320031 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:14.321901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:14.321901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:14.322089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] PATH_INFO: `/v3/projects/822519f04f8341e2b1e12bf38001c3ce/users/9f5c10580f2c4eb98298ad9ffa2d52b2/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:14.360806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=822519f04f8341e2b1e12bf38001c3ce, user_id=9f5c10580f2c4eb98298ad9ffa2d52b2, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:14.365751 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:14.463991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1099/2196] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:12:14 2022] PUT /identity/v3/projects/822519f04f8341e2b1e12bf38001c3ce/users/9f5c10580f2c4eb98298ad9ffa2d52b2/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:12:14.468471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:14.491562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d4c66-019d-4e48-992e-231e270049fa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:14.581942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74532d72-2073-4631-9b9b-666fb2ec70bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:14.582538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532d72-2073-4631-9b9b-666fb2ec70bb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:14.582982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532d72-2073-4631-9b9b-666fb2ec70bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:14.583460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74532d72-2073-4631-9b9b-666fb2ec70bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:14.584378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74532d72-2073-4631-9b9b-666fb2ec70bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:14.586070 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74532d72-2073-4631-9b9b-666fb2ec70bb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:14.613589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1098/2197] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:12:14 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:12:14.617631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:14.628644 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20f089-a819-48e4-bd21-6e251fc534ca admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:14.634231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:14.635426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:14.635718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:14.635997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] PATH_INFO: `/v3/projects/822519f04f8341e2b1e12bf38001c3ce/users/9f5c10580f2c4eb98298ad9ffa2d52b2/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:14.638030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] RBAC: Authorizing `identity:create_grant(project_id=822519f04f8341e2b1e12bf38001c3ce, user_id=9f5c10580f2c4eb98298ad9ffa2d52b2, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:14.640863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:14.652348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1100/2198] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:12:14 2022] PUT /identity/v3/projects/822519f04f8341e2b1e12bf38001c3ce/users/9f5c10580f2c4eb98298ad9ffa2d52b2/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:12:22.574635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26837e5-2557-4ef0-9b32-faba958b92bb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:22.575357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26837e5-2557-4ef0-9b32-faba958b92bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:22.575745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26837e5-2557-4ef0-9b32-faba958b92bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:22.620006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-c26837e5-2557-4ef0-9b32-faba958b92bb None None] MFA Rules not processed for user `9f5c10580f2c4eb98298ad9ffa2d52b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:22.621440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c26837e5-2557-4ef0-9b32-faba958b92bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:22.693708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1099/2199] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:12:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:22.709732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:22.712840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:22.804030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e024a1ac-84e5-423a-9233-e606f15dbded admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:22.809928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:22.810589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:22.810877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:22.811195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:22.866460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:22.868088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:22.876979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1101/2200] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:12:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:12:27.730402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3483eb-0637-448c-96a7-6e3282a38097 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:27.730900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3483eb-0637-448c-96a7-6e3282a38097 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:27.730994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3483eb-0637-448c-96a7-6e3282a38097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:27.750187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cd3483eb-0637-448c-96a7-6e3282a38097 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:12:27.751441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cd3483eb-0637-448c-96a7-6e3282a38097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:27.812209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1100/2201] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 21:12:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:12:27.836341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:12:27.837817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:12:27.913039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dedec-7af6-4581-85e5-6b1d0050da84 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:12:27.918106 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:12:27.918856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:12:27.919368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:12:27.919791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:12:27.929004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:12:27.930654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:12:27.940802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1102/2202] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:12:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:13:52.518203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3483eb-0637-448c-96a7-6e3282a38097 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:52.571209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3483eb-0637-448c-96a7-6e3282a38097 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:52.574966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:52.575663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:52.575949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:52.576242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:52.578027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:52.641900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:52.643489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:52.654301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1101/2203] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:13:57.258355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:13:57.261176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:57.285985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42de468-b7c4-4377-ad64-5c9edb74cdc7 service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:13:57.303599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:13:57.304271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:13:57.304552 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:13:57.305818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:13:57.308695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:13:57.325957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:13:57.328159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:13:57.371070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1103/2204] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:00.977977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:00.986686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2eca29-5eeb-4d9e-9e71-51c314ea1c16 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:00.990354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c241b-8c81-41c4-8387-166be861e016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:00.990996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c241b-8c81-41c4-8387-166be861e016 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:00.991317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c241b-8c81-41c4-8387-166be861e016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:00.991598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c241b-8c81-41c4-8387-166be861e016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:00.995562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d0c241b-8c81-41c4-8387-166be861e016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:01.021836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c241b-8c81-41c4-8387-166be861e016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:01.023349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c241b-8c81-41c4-8387-166be861e016 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:01.034806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1102/2205] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:02.507656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:02.516362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e812644-674e-4680-892b-e6babf39f9d0 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:02.519986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:02.520621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:02.520904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:02.521178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:02.523081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:02.580411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:02.581824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:02.591222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1104/2206] 10.222.0.49 () {60 vars in 1396 bytes} [Tue May 10 21:14:02 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:12.002563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af93ed-baa5-4c16-ad0b-b6ca7b4fbcef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:12.003138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af93ed-baa5-4c16-ad0b-b6ca7b4fbcef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:12.003138 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af93ed-baa5-4c16-ad0b-b6ca7b4fbcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:12.020247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-79af93ed-baa5-4c16-ad0b-b6ca7b4fbcef None None] MFA Rules not processed for user `fe93eb8c93fb4cb4bec6f7cc2c03e1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:12.021434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-79af93ed-baa5-4c16-ad0b-b6ca7b4fbcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:12.028973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1103/2207] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:14:15.695947 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:15.708197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d467b06-0cd8-4b4a-932e-3114ea05d873 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:15.714354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:15.714980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:15.715432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:15.715706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:15.717472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:15.776872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:15.778444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:15.787249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1105/2208] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:17.465377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af93ed-baa5-4c16-ad0b-b6ca7b4fbcef None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:17.475025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af93ed-baa5-4c16-ad0b-b6ca7b4fbcef None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:17.478724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:17.479402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:17.479687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:17.479964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:17.481749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:17.491277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:17.493407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:17.501253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1104/2209] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:25.471665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:25.483186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39067f52-e926-4fe4-a418-ea08319482f2 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:25.488686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:25.489320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:25.489605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:25.489884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:25.491708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:25.549115 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:25.550617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:25.559637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1106/2210] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:30.982438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:30.983863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:31.045716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2ff7c-db3d-4967-8a8d-26707114aaad service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:31.049318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfc06d-e9a3-4960-8bf2-05aa3ee49a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:31.049957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfc06d-e9a3-4960-8bf2-05aa3ee49a6d service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:31.050237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfc06d-e9a3-4960-8bf2-05aa3ee49a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:31.050510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfc06d-e9a3-4960-8bf2-05aa3ee49a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:31.052306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4fdfc06d-e9a3-4960-8bf2-05aa3ee49a6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:31.109830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfc06d-e9a3-4960-8bf2-05aa3ee49a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:31.111299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdfc06d-e9a3-4960-8bf2-05aa3ee49a6d service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:31.120541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1105/2211] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:34.757733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:34.772476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399c16a-290d-4c27-9593-5903d463dd65 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:34.779246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:34.779945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:34.780231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:34.780511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:34.782306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:34.795690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:34.797496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:34.816797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1107/2212] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:39.328064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:39.328064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:39.328064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:39.345322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] MFA Rules not processed for user `dc411f6a0a024e7eac561ad1b6d2a944`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:14:39.346550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:39.353527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1106/2213] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:14:39.659402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:39.669155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19461e52-72f3-415b-9819-2577ed3faf31 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:39.672708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:39.673341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:39.673627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:39.673903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:39.675686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:39.685725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:39.687141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:39.695101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1108/2214] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:40.093218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:40.094810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:40.170564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ce503-0d47-41c3-812d-302081eb321d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:40.175394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:40.176036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:40.176312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:40.176584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:40.178328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:40.190686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:40.192534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:40.202224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1107/2215] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:49.357379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:49.358861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:49.377205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674a700-23c0-48ea-b5f9-1f4bcbf14568 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:49.382437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:49.383081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:49.383503 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:49.384515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:49.387068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:49.400394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:49.402658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:49.414222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1109/2216] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:14:52.885948 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:14:52.898469 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a04fc-49e8-48fc-b0cd-dfd5aa6032a8 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:14:52.905500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:14:52.906256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:14:52.906638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:14:52.907171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:14:52.909149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:14:52.923578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:14:52.928187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:14:52.937078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1108/2217] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:15:11.907313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:15:11.917502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd1dc8-e131-40ee-b022-edd74c4c2983 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:15:11.921754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:15:11.922482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:15:11.922770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:15:11.923072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:15:11.924964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:15:11.983656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:15:11.985288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:15:11.994294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1110/2218] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:15:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:16:57.389210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:16:57.400445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c93de-ccbd-4b33-9c5a-b7bfaa37ea51 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:16:57.406302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:16:57.406963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:16:57.407279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:16:57.407563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:16:57.409360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:16:57.469565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:16:57.471205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:16:57.480186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1109/2219] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:16:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:17:31.531955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:17:31.540079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc18c8-6fb8-412e-aac7-f71eed90c306 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:17:31.543604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:17:31.544234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:17:31.544514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:17:31.544786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:17:31.553880 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:17:31.555385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:17:31.564621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1111/2220] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:17:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:18:04.044600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:18:04.057846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a2355f-936e-4d48-b156-302748248f4a service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:18:04.063528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:18:04.064247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:18:04.064596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:18:04.064879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:18:04.074789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:18:04.076429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:18:04.087298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1110/2221] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:18:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:19:01.182666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:19:01.191761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be545f32-685c-4614-966c-b0a972576bea service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:19:01.195330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:19:01.196216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:19:01.196496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:19:01.196767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:19:01.207658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:19:01.209080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:19:01.220718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1112/2222] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:19:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:19:02.861950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:19:02.874172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af412d8b-71a7-43dd-b470-fbe06ab2a2ec service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:19:02.879556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:19:02.880186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:19:02.880467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:19:02.880769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:19:02.888541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:19:02.890297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:19:02.916597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1111/2223] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:19:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:19:15.598700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:19:15.612214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66249a2-367b-48cb-962a-dbcf814db03e service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:19:15.617796 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:19:15.618466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:19:15.618748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:19:15.619021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:19:15.628066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:19:15.629632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:19:15.660022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1113/2224] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:19:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:19:24.938471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:19:24.945964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e199864-2c58-4557-84b4-48de6ad8fcc3 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:19:24.953031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:19:24.953678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:19:24.953963 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:19:24.954237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:19:24.962318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:19:24.963955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:19:24.973335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1112/2225] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:19:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:19:31.829915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:19:31.838931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f796e6-609a-445c-baca-59ac03022f65 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:19:31.843453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:19:31.844095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:19:31.844372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:19:31.844641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:19:31.853154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:19:31.854567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:19:31.881695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1114/2226] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:19:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:20:02.747067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:20:02.756130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f466d-ec5b-4104-ba26-fda41f355ca2 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:20:02.759908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:20:02.760553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:20:02.760838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:20:02.761117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:20:02.768437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:20:02.769917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:20:02.778717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1113/2227] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:20:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:21:32.127143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:21:32.145480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aaf10d-273a-4b91-bbe6-ba4889e9398a service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:21:32.149095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:21:32.149732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:21:32.150011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:21:32.150287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:21:32.173047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:21:32.174462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:21:32.201323 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1115/2228] 10.222.0.49 () {60 vars in 1396 bytes} [Tue May 10 21:21:32 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3248 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:08.012668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:08.060315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9ac84-4dd5-4cce-b59a-cd5c0a502677 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:08.066203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:08.066845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:08.067140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:08.067440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:08.069343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:08.102272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:08.103908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:08.114147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1114/2229] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:23:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:23:32.683903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:32.695527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:23:32.695527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:32.701374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068f634c-8425-4c5b-b341-e3ae79e7cb9c service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:32.705222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:32.705864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:32.706147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:32.706497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:32.708457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:23:32.793420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:32.794847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:32.798437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65759b32-29c1-48b2-9ee1-948930a25b50 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:23:32.805563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:23:32.806208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:23:32.806490 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:23:32.806768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:23:32.813862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1116/2230] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:23:32.814811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:23:32.816443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:23:32.844886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1115/2231] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:23:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:09.719390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:09.721007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:09.796581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc9f81-8b17-48aa-89d1-6c36168da03d service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:09.800160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:09.800798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:09.801077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:09.801351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:09.803228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:09.812294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:09.813700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:09.821264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1117/2232] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:25:33.008135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.009987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:33.079217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd81df-3913-4867-9c92-04e82403fa44 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.082920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.083594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.083880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.084162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.086079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:33.099354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.100800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.112556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1116/2233] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:33.164918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.177349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb1581-74c6-4d9b-beec-b36cfdc42014 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.184995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.186200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.186200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.186200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.188268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:33.193382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.202429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642898b-d0c8-4b93-91c5-4a65ff30963c service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.206220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.206875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.207185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.207467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.209389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:33.263339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.264870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.274015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1118/2234] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:25:33.285099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.286555 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.295939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1117/2235] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:25:33.475420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.486166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e702d-6846-426d-93e4-63ce7ae06cb2 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.491572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.492202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.492486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.492764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.495114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:33.571441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.573502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.591555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1119/2236] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:33.643750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:33.656577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72226d1c-27ba-464e-8b5b-8d3d0dfd1314 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:33.662240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:33.664805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:33.664805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:33.664805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:33.665446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:33.734804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:33.736437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:33.746181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1118/2237] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:34.216113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:34.227194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c15813-2b44-4500-87d3-0d6fa07d30c9 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:34.233247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:34.233874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:34.234158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:34.234431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:34.236325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:34.248308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:34.249890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:34.260390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1120/2238] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:36.569145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:36.599965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7d6e7-da8e-4428-ac17-9d62dd992f66 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:36.629556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:36.630461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:36.630926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:36.631420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:36.633804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:36.647827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:36.649620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:36.666238 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1119/2239] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:25:57.257643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:25:57.259410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:57.270832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78c990-52a9-473f-a2b8-893b52a65fd2 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:25:57.274441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:25:57.275081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:25:57.275405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:25:57.275681 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:25:57.278237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:25:57.362613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:25:57.364075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:25:57.382892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1121/2240] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:26:05.456939 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:05.458598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:05.474302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47709bd8-d15a-435e-b077-053464affd17 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:05.478824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:05.479725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:05.480014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:05.480297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] PATH_INFO: `/v3/users/1d97010c72384a4e9714e9630397e0e8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:05.481801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d97010c72384a4e9714e9630397e0e8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:05.483770 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:05.638474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d97010c72384a4e9714e9630397e0e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:05.645362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d97010c72384a4e9714e9630397e0e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:05.716338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d97010c72384a4e9714e9630397e0e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:05.728259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d97010c72384a4e9714e9630397e0e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:05.734428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d97010c72384a4e9714e9630397e0e8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:05.740882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1120/2241] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:26:05 2022] DELETE /identity/v3/users/1d97010c72384a4e9714e9630397e0e8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:05.988992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:05.999924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a23e6-8ca7-4e13-ad16-8084052ee477 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:06.059309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:06.060314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:06.060429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:06.060725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] PATH_INFO: `/v3/projects/07437b61b6dc4f70af85bb413e294295` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:06.061969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07437b61b6dc4f70af85bb413e294295)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:06.063900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:06.171639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07437b61b6dc4f70af85bb413e294295', 'request_id': 'req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.176868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07437b61b6dc4f70af85bb413e294295', 'request_id': 'req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.182911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07437b61b6dc4f70af85bb413e294295', 'request_id': 'req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.247337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] The token cache is being invalidate because project 07437b61b6dc4f70af85bb413e294295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:26:06.247533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.248164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.249705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1122/2242] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:26:05 2022] DELETE /identity/v3/projects/07437b61b6dc4f70af85bb413e294295 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:06.253750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:06.255234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:06.268736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ba4f5-ad31-4907-bc92-1603d3e5d934 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:06.330371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:06.331420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:06.331603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:06.331821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] PATH_INFO: `/v3/users/9f5c10580f2c4eb98298ad9ffa2d52b2` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:06.346395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5c10580f2c4eb98298ad9ffa2d52b2)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:06.348615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:06.532105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5c10580f2c4eb98298ad9ffa2d52b2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.538901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5c10580f2c4eb98298ad9ffa2d52b2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.615222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5c10580f2c4eb98298ad9ffa2d52b2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.628294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5c10580f2c4eb98298ad9ffa2d52b2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.630278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5c10580f2c4eb98298ad9ffa2d52b2'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:06.634826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1121/2243] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:26:06 2022] DELETE /identity/v3/users/9f5c10580f2c4eb98298ad9ffa2d52b2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:26:06.862990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:26:06.864467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:26:06.877758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68fabc-ae3c-4498-9322-8c0ff6cde24a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:26:06.943488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:26:06.944775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:26:06.945070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:26:06.945347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] PATH_INFO: `/v3/projects/822519f04f8341e2b1e12bf38001c3ce` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:26:06.956798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=822519f04f8341e2b1e12bf38001c3ce)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:26:06.958721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:26:07.061992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '822519f04f8341e2b1e12bf38001c3ce', 'request_id': 'req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.067737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '822519f04f8341e2b1e12bf38001c3ce', 'request_id': 'req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.074919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '822519f04f8341e2b1e12bf38001c3ce', 'request_id': 'req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.167386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] The token cache is being invalidate because project 822519f04f8341e2b1e12bf38001c3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:26:07.167683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.168929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:26:07.170693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1123/2244] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:26:06 2022] DELETE /identity/v3/projects/822519f04f8341e2b1e12bf38001c3ce => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:27:37.747603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:27:37.749169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:37.804844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e1279-ec02-4fe8-a81e-58d02fb7d0a0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:27:37.852119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:27:37.852751 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:27:37.853031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:27:37.853305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:27:37.855054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:27:37.922730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:27:37.924102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:27:37.933055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1122/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:27:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:15.008018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:15.009447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:15.079395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6bd19c-4fa8-4aba-bfa4-e3696442ee0d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:15.086120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:15.086765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:15.087049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:15.087354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:15.089117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:15.100923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:15.102489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:15.113190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1124/2246] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:28:33.040099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:28:33.041520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:33.113424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e440f7-3694-4e3c-8087-2f0c486d705e service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:28:33.118848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:28:33.119520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:28:33.119805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:28:33.120083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:28:33.121843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:28:33.188837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:28:33.190596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:28:33.199472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1123/2247] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:28:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:13.714937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:13.716378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:13.771252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc170d1f-ac89-4dc0-997d-3b02ffd9a98a service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:13.774790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:13.775449 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:13.775736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:13.776020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:13.778575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:13.787669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:13.789074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:13.796924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1125/2248] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:30:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:34.072105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:34.083745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b1e93b-3770-4fb1-bcb6-bbbc06e09172 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:34.089728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:34.090367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:34.090649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:34.090923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:34.092719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:34.159796 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:34.161429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:34.180127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1124/2249] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:30:34.230110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:30:34.238374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8697465-a1c5-45a6-9b3e-4ca7384e9159 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:30:34.241921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:30:34.242545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:30:34.242833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:30:34.243106 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:30:34.244982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:30:34.258556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:30:34.260005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:30:34.271371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1126/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:30:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:37.978762 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:37.982433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:37.993378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d8fc7-6930-4f9c-882a-8713d4387da4 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:37.997194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:37.997845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:37.998126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:37.998399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:38.000368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:38.080409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:38.081897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:38.093309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1125/2251] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:38.189127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:38.190515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:38.204801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c4a65-e5d3-43e9-bfdf-4bfc9c3e2b16 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:38.208815 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857fc3a-381d-4ac4-b5f4-1685457db506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:38.209467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857fc3a-381d-4ac4-b5f4-1685457db506 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:38.209748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857fc3a-381d-4ac4-b5f4-1685457db506 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:38.210024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857fc3a-381d-4ac4-b5f4-1685457db506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:38.211811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c857fc3a-381d-4ac4-b5f4-1685457db506 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:38.282036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857fc3a-381d-4ac4-b5f4-1685457db506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:38.283522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857fc3a-381d-4ac4-b5f4-1685457db506 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:38.303875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1127/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:38.397809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:38.407001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9496189-4d08-4316-995a-0103fa450aa4 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:38.410668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:38.411363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:38.411655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:38.411935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:38.413798 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:38.483643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:38.485117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:38.504839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1126/2253] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:38.547544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cc631-7eaa-4e2a-8d94-8e27d18c6cb0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:38.547544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cc631-7eaa-4e2a-8d94-8e27d18c6cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:38.547544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388cc631-7eaa-4e2a-8d94-8e27d18c6cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:38.581813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-388cc631-7eaa-4e2a-8d94-8e27d18c6cb0 None None] MFA Rules not processed for user `da06520884ff4677af84f9e7356818ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:31:38.583260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-388cc631-7eaa-4e2a-8d94-8e27d18c6cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:38.591461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1128/2254] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:31:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:31:38.895367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:38.904772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1461aa-f2bb-4fbc-b492-2ab9034e805b service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:38.908647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:38.909398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:38.909753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:38.910096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:38.911987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:38.922611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:38.924073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:38.932236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1127/2255] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:39.323546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cc631-7eaa-4e2a-8d94-8e27d18c6cb0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:39.341576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388cc631-7eaa-4e2a-8d94-8e27d18c6cb0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:39.350387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:39.351280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:39.351803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:39.352175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:39.354674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:39.378002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:39.381112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:39.395029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1129/2256] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:43.696699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:43.712196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fca9a-fb41-46c2-b436-830b75cd7c2b service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:43.719864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:43.729008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:43.729319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:43.729605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:43.732842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:43.747285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:43.748938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:43.760448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1128/2257] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:46.278694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:46.280935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:46.297821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb7945-8444-4870-a382-320872ec50e8 service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:46.302463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:46.303341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:46.303622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:46.304049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] PATH_INFO: `/v3/users/4c4ab23d3e7b4b018d144bea8b98dc24` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:46.305251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c4ab23d3e7b4b018d144bea8b98dc24)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:46.307445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:46.505240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c4ab23d3e7b4b018d144bea8b98dc24'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:46.554050 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c4ab23d3e7b4b018d144bea8b98dc24'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:46.567279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c4ab23d3e7b4b018d144bea8b98dc24'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:46.567986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c4ab23d3e7b4b018d144bea8b98dc24'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:46.576285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c4ab23d3e7b4b018d144bea8b98dc24'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:46.582411 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1130/2258] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:31:46 2022] DELETE /identity/v3/users/4c4ab23d3e7b4b018d144bea8b98dc24 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:31:46.817998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:46.830387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54c2e-ad42-4361-92eb-3c391f0bfdaa service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:46.892536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:46.893407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:46.893691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:46.893967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] PATH_INFO: `/v3/projects/fa59d3d177fb4b578fecee910e079117` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:46.895221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa59d3d177fb4b578fecee910e079117)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:46.897147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:47.003379 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa59d3d177fb4b578fecee910e079117', 'request_id': 'req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.077896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa59d3d177fb4b578fecee910e079117', 'request_id': 'req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.084230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa59d3d177fb4b578fecee910e079117', 'request_id': 'req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.096472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] The token cache is being invalidate because project fa59d3d177fb4b578fecee910e079117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:31:47.096784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.097447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.099103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1129/2259] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:31:46 2022] DELETE /identity/v3/projects/fa59d3d177fb4b578fecee910e079117 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:31:47.103066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:47.104528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:47.117312 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84f5c9-786d-4290-af71-ea5e285360a2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:47.171777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:47.172642 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:47.172926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:47.173207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] PATH_INFO: `/v3/users/dedc8ab5caae4baca6e967b3c9dc2ccc` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:47.186665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedc8ab5caae4baca6e967b3c9dc2ccc)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:47.188592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:47.353987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedc8ab5caae4baca6e967b3c9dc2ccc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.420829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedc8ab5caae4baca6e967b3c9dc2ccc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.433183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedc8ab5caae4baca6e967b3c9dc2ccc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.435356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedc8ab5caae4baca6e967b3c9dc2ccc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.442523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedc8ab5caae4baca6e967b3c9dc2ccc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.448460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1131/2260] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:31:47 2022] DELETE /identity/v3/users/dedc8ab5caae4baca6e967b3c9dc2ccc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:31:47.700064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:47.703348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:47.719920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80b8b0-d807-436a-8be9-3e1ce2bd7163 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:47.781510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:47.782387 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:47.782674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:47.782953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] PATH_INFO: `/v3/projects/3d3b5d65ba974a51a25579873fe2681f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:47.793994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3b5d65ba974a51a25579873fe2681f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:47.796187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:47.890241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3b5d65ba974a51a25579873fe2681f', 'request_id': 'req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.947808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3b5d65ba974a51a25579873fe2681f', 'request_id': 'req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.954574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3b5d65ba974a51a25579873fe2681f', 'request_id': 'req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.966724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] The token cache is being invalidate because project 3d3b5d65ba974a51a25579873fe2681f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:31:47.967011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.967683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:31:47.969220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1130/2261] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:31:47 2022] DELETE /identity/v3/projects/3d3b5d65ba974a51a25579873fe2681f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:31:49.009496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:49.011040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:49.086564 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97399fb6-079b-4618-abd1-10bea9071ec3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:49.146454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:49.147093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:49.147407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:49.147680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:49.149413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:49.161960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:49.163493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:49.173676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1132/2262] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:31:57.420474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:31:57.421921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:57.481618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55adf29-c3d9-4e85-bf0b-aa3ce3ed52c5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:31:57.485354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:31:57.485998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:31:57.486284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:31:57.486566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:31:57.488451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:31:57.548427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:31:57.549838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:31:57.558728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1131/2263] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:31:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:33:18.975762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:33:18.977176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:19.100198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3287dc8b-65e1-456a-8a9a-4d4004a99d95 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:33:19.105085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:33:19.105752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:19.106032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:19.106307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:19.108401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:19.119762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:33:19.121322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:33:19.131390 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1133/2264] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:33:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:33:38.621030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:33:38.622516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:38.669535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c736740-ef9f-4a9f-aa47-633f34666df9 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:33:38.673814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:33:38.674463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:38.674745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:38.675021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:38.676813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:38.744922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:33:38.746368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:33:38.764371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1132/2265] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:33:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:33:58.440768 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:33:58.450416 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707e5cc-7a16-4f22-a781-05162d8be921 service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:33:58.459342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:33:58.461068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:33:58.463510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:33:58.464042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:33:58.471890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] Could not find project: fa59d3d177fb4b578fecee910e079117.: keystone.exception.ProjectNotFound: Could not find project: fa59d3d177fb4b578fecee910e079117. May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application Traceback (most recent call last): May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') May 10 21:33:58.491827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application token = self._validate_token(token_id) May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:33:58.493988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self._validate_token_resources() May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 10 21:33:58.495742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.get_or_create( May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application with Lock( May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._enter() May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.creator() May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application created_value = creator( May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 10 21:33:58.497291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 10 21:33:58.498607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fa59d3d177fb4b578fecee910e079117. May 10 21:33:58.498607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: ERROR keystone.server.flask.application May 10 21:33:58.498607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1134/2266] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:33:58 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) May 10 21:35:18.711895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:35:18.713376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:18.787889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663fe39-2bf3-4879-a909-d10148939109 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:35:18.791439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:35:18.792075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:18.792352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:18.792623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:18.794368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:18.804101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:35:18.805564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:35:18.813147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1133/2267] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:35:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:35:34.748916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:35:34.759166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20785c-f539-42d8-a7e1-d7c15fbd9f32 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:35:34.762696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:35:34.763361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:34.763648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:34.763959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:34.765767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:34.798000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:35:34.799451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:35:34.819661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1135/2268] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:35:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:35:38.875031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:35:38.885787 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7800c6f-c9e9-435f-8207-e946fcdfb4bf service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:35:38.889355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:35:38.890235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:35:38.890513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:35:38.890788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:35:38.892890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:35:38.987957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:35:38.989565 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:35:39.000157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1134/2269] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:35:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:36:37.069488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:36:37.070966 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:36:37.085002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e469353-cf52-4252-b477-f954c98e7c63 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:36:37.091222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:36:37.091872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:36:37.092157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:36:37.092434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:36:37.094206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:36:37.163547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:36:37.165150 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:36:37.174239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1136/2270] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:36:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:36:56.806107 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:36:56.815215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab5825-6050-4719-93b3-47d8ead2bc02 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:36:56.818748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:36:56.819424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:36:56.819703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:36:56.819980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:36:56.828320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:36:56.829741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:36:56.856956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1135/2271] 10.222.0.49 () {60 vars in 1396 bytes} [Tue May 10 21:36:56 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:37:39.484353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:37:39.492895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cd1b3f-a79d-44a1-96aa-6fbc35831290 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:37:39.497347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917d944-0a23-4225-96f1-e9efcb2b71cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:37:39.498361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d944-0a23-4225-96f1-e9efcb2b71cb service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:37:39.499027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d944-0a23-4225-96f1-e9efcb2b71cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:37:39.509265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d944-0a23-4225-96f1-e9efcb2b71cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:37:39.509265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6917d944-0a23-4225-96f1-e9efcb2b71cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:37:39.584608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917d944-0a23-4225-96f1-e9efcb2b71cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:37:39.586166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917d944-0a23-4225-96f1-e9efcb2b71cb service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:37:39.596829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1137/2272] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:37:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:37:41.439839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:37:41.457846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c1907-61af-41aa-a546-418aa8ca26bb service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:37:41.464443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:37:41.465515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:37:41.466045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:37:41.466535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:37:41.469058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:37:41.486164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:37:41.487955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:37:41.500116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1136/2273] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:37:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:38:02.176324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe084-48d7-4da8-9972-536ef0f46da7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:38:02.176867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe084-48d7-4da8-9972-536ef0f46da7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:38:02.176867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe084-48d7-4da8-9972-536ef0f46da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:38:02.216548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-83dfe084-48d7-4da8-9972-536ef0f46da7 None None] MFA Rules not processed for user `62bc5605a22d408f9b4bac69a0f5f486`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:38:02.217755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-83dfe084-48d7-4da8-9972-536ef0f46da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:38:02.225474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1138/2274] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:38:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:38:02.528124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:38:02.538251 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b830282f-b862-4a42-a1bb-a70e79398feb service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:38:02.543075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:38:02.543738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:38:02.544248 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:38:02.544844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:38:02.547098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:38:02.556684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:38:02.558092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:38:02.566016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1137/2275] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:38:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:38:02.991746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe084-48d7-4da8-9972-536ef0f46da7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:38:03.003265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe084-48d7-4da8-9972-536ef0f46da7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:38:03.008181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:38:03.008821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:38:03.009105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:38:03.009380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:38:03.011160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:38:03.023328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:38:03.024933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:38:03.035533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1139/2276] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:38:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:38:10.841273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:38:10.854276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a309e1ee-fcca-4398-8e11-357e030aca57 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:38:10.859877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:38:10.861083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:38:10.861366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:38:10.861641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:38:10.870454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:38:10.872686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:38:10.888704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1138/2277] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:38:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:38:24.998141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:38:25.008710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfca9a6-72e3-45f1-aa8c-3048d1c10f36 service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:38:25.013960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:38:25.014603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:38:25.014891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:38:25.015206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:38:25.024418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:38:25.026209 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:38:25.037087 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1140/2278] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:38:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:38:38.745175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:38:38.756363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124bf1f-e845-48a4-bfe4-199b60b14052 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:38:38.761828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:38:38.762456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:38:38.762736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:38:38.763009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:38:38.770685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:38:38.772326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:38:38.781059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1139/2279] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:38:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:39:59.071718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:39:59.080973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9ce93-2042-4aaa-974d-2bf156d2233f service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:39:59.085507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:39:59.085934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:39:59.086191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:39:59.086467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:39:59.088281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:39:59.171506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:39:59.172837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:39:59.191854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1141/2280] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:40:01.453644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:01.466231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e293f-a9b1-4f41-a4c6-5d55db767480 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:01.472840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:01.473498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:01.473950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:01.474413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:01.476824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:01.490162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:01.493009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:01.505160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1140/2281] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:40:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:40:03.859435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:03.860856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:03.873653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ff7e-0398-4868-9087-7e99080783c3 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:03.877949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:03.878810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:03.879093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:03.879410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] PATH_INFO: `/v3/users/da06520884ff4677af84f9e7356818ef` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:03.880608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] RBAC: Authorizing `identity:delete_user(user_id=da06520884ff4677af84f9e7356818ef)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:03.883313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:04.087888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da06520884ff4677af84f9e7356818ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.165196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da06520884ff4677af84f9e7356818ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.177016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da06520884ff4677af84f9e7356818ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.179699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da06520884ff4677af84f9e7356818ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.184982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b47dba6e-1dcb-4e68-bec8-e5fd0541444d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da06520884ff4677af84f9e7356818ef'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.191020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1142/2282] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:40:03 2022] DELETE /identity/v3/users/da06520884ff4677af84f9e7356818ef => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:04.437539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:04.450685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b438896-decc-4038-8f48-c5f7c173f5bb service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:04.509779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:04.510634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:04.510913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:04.511215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] PATH_INFO: `/v3/projects/8df9bf1cf45743dc8206cab528d583a1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:04.512384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df9bf1cf45743dc8206cab528d583a1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:04.514278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:04.630737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df9bf1cf45743dc8206cab528d583a1', 'request_id': 'req-a0ba1b03-8836-4c81-a322-dab49fa84568'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.693377 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df9bf1cf45743dc8206cab528d583a1', 'request_id': 'req-a0ba1b03-8836-4c81-a322-dab49fa84568'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.699872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df9bf1cf45743dc8206cab528d583a1', 'request_id': 'req-a0ba1b03-8836-4c81-a322-dab49fa84568'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.711720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] The token cache is being invalidate because project 8df9bf1cf45743dc8206cab528d583a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:40:04.712004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.712636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a0ba1b03-8836-4c81-a322-dab49fa84568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:04.714166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1141/2283] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:40:04 2022] DELETE /identity/v3/projects/8df9bf1cf45743dc8206cab528d583a1 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:04.720210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2119a-447c-463b-84cf-b5e58e3319e0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:04.720499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2119a-447c-463b-84cf-b5e58e3319e0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:04.720841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2119a-447c-463b-84cf-b5e58e3319e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:04.775373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-eeb2119a-447c-463b-84cf-b5e58e3319e0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:04.776569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-eeb2119a-447c-463b-84cf-b5e58e3319e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:04.832536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1143/2284] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:04.841443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32961f6c-cc31-4440-8b14-cbcf20a63aec None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:04.841729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32961f6c-cc31-4440-8b14-cbcf20a63aec None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:04.842004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32961f6c-cc31-4440-8b14-cbcf20a63aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:04.860373 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-32961f6c-cc31-4440-8b14-cbcf20a63aec None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:04.861568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-32961f6c-cc31-4440-8b14-cbcf20a63aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:04.870077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1142/2285] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:04.874141 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2119a-447c-463b-84cf-b5e58e3319e0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:04.884597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2119a-447c-463b-84cf-b5e58e3319e0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:04.889119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:04.889770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:04.890055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:04.890334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:04.891066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:40:04.891404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:04.893007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:04.905152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1144/2286] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:40:04.909460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32961f6c-cc31-4440-8b14-cbcf20a63aec None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:04.919097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32961f6c-cc31-4440-8b14-cbcf20a63aec None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:04.923792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:04.924433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:04.924716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:04.924993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:04.925690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:04.927670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:05.066818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1143/2287] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:40:04 2022] POST /identity/v3/projects => generated 405 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:05.071964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:05.081943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d3cd-b987-4e54-add8-9191429ac065 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:05.138714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:05.139409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:05.139693 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:05.143971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:05.143971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:05.143971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:05.213934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1145/2288] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:40:05 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:05.218293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:05.228759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408bd26-a8e5-444a-8043-63fce8865bff admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:05.233284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:05.233925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:05.234205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:05.234474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:05.235252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:05.236839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:05.246535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1144/2289] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:05.250400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:05.260842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ecffa-6ea2-49df-a1bd-d22b37cd2df5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:05.265427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50618487-4a00-4e4e-b267-18f68adb751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:05.266413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618487-4a00-4e4e-b267-18f68adb751b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:05.266702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618487-4a00-4e4e-b267-18f68adb751b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:05.266979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50618487-4a00-4e4e-b267-18f68adb751b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:05.267854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50618487-4a00-4e4e-b267-18f68adb751b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:05.269436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50618487-4a00-4e4e-b267-18f68adb751b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:05.281041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1146/2290] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:05.284990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:05.295293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b9163f-3bbb-408d-830a-b9b74fd9fcc4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:05.299888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:05.300892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:05.301181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:05.301458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] PATH_INFO: `/v3/projects/bf85078a69dc4d9cb57fe687a6364fba/users/c9a68788f49a4e4e9dc31b77c58f6155/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:05.316005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf85078a69dc4d9cb57fe687a6364fba, user_id=c9a68788f49a4e4e9dc31b77c58f6155, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:05.318703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:05.385275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1145/2291] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:40:05 2022] PUT /identity/v3/projects/bf85078a69dc4d9cb57fe687a6364fba/users/c9a68788f49a4e4e9dc31b77c58f6155/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:05.390708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad0897-f4ae-4bea-a4ec-3c07b86ff398 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:05.391036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad0897-f4ae-4bea-a4ec-3c07b86ff398 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:05.391334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad0897-f4ae-4bea-a4ec-3c07b86ff398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:05.408595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c6ad0897-f4ae-4bea-a4ec-3c07b86ff398 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:05.409777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c6ad0897-f4ae-4bea-a4ec-3c07b86ff398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:05.466680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1147/2292] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:05.476233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:05.478061 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:05.533754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bbc1f-49ab-4b4f-b7e7-cbfc1ac434aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:05.537319 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:05.538142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:05.538419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:05.538692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:05.547533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:05.548959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:05.558950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1146/2293] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:40:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:40:06.781974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4c78-6da5-4a85-b797-77f687a69b91 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:06.782540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4c78-6da5-4a85-b797-77f687a69b91 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:06.782540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4c78-6da5-4a85-b797-77f687a69b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:06.869590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d13a4c78-6da5-4a85-b797-77f687a69b91 None None] MFA Rules not processed for user `c9a68788f49a4e4e9dc31b77c58f6155`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:06.870864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d13a4c78-6da5-4a85-b797-77f687a69b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:06.933264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1148/2294] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:06 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:06.938036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:06.948241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a76ee1-7818-4852-82cf-9ec18ce317e7 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:06.952878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:06.953529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:06.953814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:06.954091 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:06.954797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:06.956738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:07.047232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1147/2295] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:40:06 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:07.050191 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a4c78-6da5-4a85-b797-77f687a69b91 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:07.061454 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a4c78-6da5-4a85-b797-77f687a69b91 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:07.118773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:07.119493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:07.119776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:07.120047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:07.120742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:07.122627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:07.210925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1149/2296] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:40:07 2022] POST /identity/v3/users => generated 308 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:07.214880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:07.225420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fc02d-ddd6-47b6-8d79-358cd43e2582 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:07.230362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:07.231019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:07.231326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:07.231599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:07.232321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:07.233906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:07.244971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1148/2297] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:07.249190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:07.259673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd004c7d-8953-4cff-8086-8679c95e0b09 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:07.264296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:07.265166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:07.265448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:07.265724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] PATH_INFO: `/v3/projects/9dd516feda3843bb8fec651c6f58f352/users/0f2ff2ab3d734ba8b96e6828d4cd5b36/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:07.280041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd516feda3843bb8fec651c6f58f352, user_id=0f2ff2ab3d734ba8b96e6828d4cd5b36, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:07.282691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:07.354635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1150/2298] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:40:07 2022] PUT /identity/v3/projects/9dd516feda3843bb8fec651c6f58f352/users/0f2ff2ab3d734ba8b96e6828d4cd5b36/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:07.358576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:07.369176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5c33c-153c-4aaf-a82d-6c13dafedb40 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:07.422623 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96cb8d-ab2c-428b-bb52-85b1533e49a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:07.423315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96cb8d-ab2c-428b-bb52-85b1533e49a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:07.423596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96cb8d-ab2c-428b-bb52-85b1533e49a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:07.423866 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96cb8d-ab2c-428b-bb52-85b1533e49a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:07.424586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96cb8d-ab2c-428b-bb52-85b1533e49a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:07.426178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96cb8d-ab2c-428b-bb52-85b1533e49a8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:07.436172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1149/2299] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:07.440392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:07.450667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3041d68-29c4-42db-b746-1111d6ecb828 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:07.455135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:07.456005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:07.456284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:07.456557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] PATH_INFO: `/v3/projects/9dd516feda3843bb8fec651c6f58f352/users/0f2ff2ab3d734ba8b96e6828d4cd5b36/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:07.458529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd516feda3843bb8fec651c6f58f352, user_id=0f2ff2ab3d734ba8b96e6828d4cd5b36, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:07.461331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:07.471575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1151/2300] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:40:07 2022] PUT /identity/v3/projects/9dd516feda3843bb8fec651c6f58f352/users/0f2ff2ab3d734ba8b96e6828d4cd5b36/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:08.665099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076421-db61-412c-a5c8-aabab0d3b6a2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:08.665592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076421-db61-412c-a5c8-aabab0d3b6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:08.665592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1076421-db61-412c-a5c8-aabab0d3b6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:08.692985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e1076421-db61-412c-a5c8-aabab0d3b6a2 None None] MFA Rules not processed for user `0f2ff2ab3d734ba8b96e6828d4cd5b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:08.694255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e1076421-db61-412c-a5c8-aabab0d3b6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:08.762487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1150/2301] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:10.039694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:10.100033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4c785-9061-4c9b-8c50-55dc16c21612 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:10.105316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:10.106179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:10.106460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:10.106738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] PATH_INFO: `/v3/users/c9a68788f49a4e4e9dc31b77c58f6155` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:10.107962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a68788f49a4e4e9dc31b77c58f6155)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:10.109889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:10.315156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a68788f49a4e4e9dc31b77c58f6155'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.399423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a68788f49a4e4e9dc31b77c58f6155'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.411403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a68788f49a4e4e9dc31b77c58f6155'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.412065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a68788f49a4e4e9dc31b77c58f6155'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.418739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a68788f49a4e4e9dc31b77c58f6155'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.424576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1152/2302] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:40:10 2022] DELETE /identity/v3/users/c9a68788f49a4e4e9dc31b77c58f6155 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:10.663682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1076421-db61-412c-a5c8-aabab0d3b6a2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:10.674385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1076421-db61-412c-a5c8-aabab0d3b6a2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:10.737845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:10.738694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:10.738975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:10.739307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] PATH_INFO: `/v3/projects/bf85078a69dc4d9cb57fe687a6364fba` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:10.740482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf85078a69dc4d9cb57fe687a6364fba)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:10.743288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:10.864829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf85078a69dc4d9cb57fe687a6364fba', 'request_id': 'req-4f74dff8-953c-43f1-8e1e-3e380ad469a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.931134 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf85078a69dc4d9cb57fe687a6364fba', 'request_id': 'req-4f74dff8-953c-43f1-8e1e-3e380ad469a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.937111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf85078a69dc4d9cb57fe687a6364fba', 'request_id': 'req-4f74dff8-953c-43f1-8e1e-3e380ad469a0'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.948870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] The token cache is being invalidate because project bf85078a69dc4d9cb57fe687a6364fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:40:10.949158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.949797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:10.951365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1151/2303] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:40:10 2022] DELETE /identity/v3/projects/bf85078a69dc4d9cb57fe687a6364fba => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:10.955378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:10.956771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:10.969619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b94985-9e78-427d-9f86-db5e42697453 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:11.029881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:11.030763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:11.031048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:11.031350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] PATH_INFO: `/v3/users/0f2ff2ab3d734ba8b96e6828d4cd5b36` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:11.032680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f2ff2ab3d734ba8b96e6828d4cd5b36)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:11.034616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:11.215577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f2ff2ab3d734ba8b96e6828d4cd5b36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.293304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f2ff2ab3d734ba8b96e6828d4cd5b36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.305713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f2ff2ab3d734ba8b96e6828d4cd5b36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.306356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f2ff2ab3d734ba8b96e6828d4cd5b36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.313043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96fd97f4-b5df-4430-8325-dcaa340e2bab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f2ff2ab3d734ba8b96e6828d4cd5b36'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.318735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1153/2304] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:40:10 2022] DELETE /identity/v3/users/0f2ff2ab3d734ba8b96e6828d4cd5b36 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:40:11.560936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:11.562358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:11.574905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f74dff8-953c-43f1-8e1e-3e380ad469a0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:11.634093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:11.634949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:11.635265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:11.635543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] PATH_INFO: `/v3/projects/9dd516feda3843bb8fec651c6f58f352` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:11.636714 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd516feda3843bb8fec651c6f58f352)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:11.638615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:11.738519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd516feda3843bb8fec651c6f58f352', 'request_id': 'req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.813314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd516feda3843bb8fec651c6f58f352', 'request_id': 'req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.819003 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd516feda3843bb8fec651c6f58f352', 'request_id': 'req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.830517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] The token cache is being invalidate because project 9dd516feda3843bb8fec651c6f58f352 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:40:11.830801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.831523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8c41f9b8-1ffa-4792-82ba-4b84ae7580b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:40:11.833041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1152/2305] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:40:11 2022] DELETE /identity/v3/projects/9dd516feda3843bb8fec651c6f58f352 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:40:11.838679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01dbc2-15f9-4d05-b9eb-a0716f0adda6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:11.838998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01dbc2-15f9-4d05-b9eb-a0716f0adda6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:11.839313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc01dbc2-15f9-4d05-b9eb-a0716f0adda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:11.857494 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-cc01dbc2-15f9-4d05-b9eb-a0716f0adda6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:11.858701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cc01dbc2-15f9-4d05-b9eb-a0716f0adda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:11.917520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1154/2306] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:11.925415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc36c-c5a4-4379-b70d-1ae34571a0d8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:11.925701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc36c-c5a4-4379-b70d-1ae34571a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:11.925976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cc36c-c5a4-4379-b70d-1ae34571a0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:11.944157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-334cc36c-c5a4-4379-b70d-1ae34571a0d8 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:11.946039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-334cc36c-c5a4-4379-b70d-1ae34571a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:11.954142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1153/2307] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:11.958321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01dbc2-15f9-4d05-b9eb-a0716f0adda6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:11.968882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc01dbc2-15f9-4d05-b9eb-a0716f0adda6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:11.973480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:11.974120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:11.974404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:11.974683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:11.975466 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:40:11.975774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:11.977574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:11.988784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1155/2308] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:40:11.993213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cc36c-c5a4-4379-b70d-1ae34571a0d8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.002275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cc36c-c5a4-4379-b70d-1ae34571a0d8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.007209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.008344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.008784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.008993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.009689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.011599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.109220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1154/2309] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:40:11 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:12.113240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.123608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42869c5e-e8ef-45be-97ed-83eb713499c5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.177492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.178157 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.178436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.178711 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.179424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.182047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.255891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1156/2310] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:40:12 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:12.261219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.271415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b448d-d861-4742-938d-655acd321fab admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.277076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.277732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.278029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.278292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.279019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.280649 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.291887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1155/2311] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:12.295856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.305792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41158f95-885d-4a53-8d53-cc28c0eaf122 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.310480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06677d-e0aa-48a8-9193-d543c5b453b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.311140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06677d-e0aa-48a8-9193-d543c5b453b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.311419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06677d-e0aa-48a8-9193-d543c5b453b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.311691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06677d-e0aa-48a8-9193-d543c5b453b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.312418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06677d-e0aa-48a8-9193-d543c5b453b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.313993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06677d-e0aa-48a8-9193-d543c5b453b4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.323963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1157/2312] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:12.327872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.338616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8bae8-d7be-47d9-b1ab-2b744050fd38 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.343614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.344472 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.344757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.345030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] PATH_INFO: `/v3/projects/6f2ad2148aed4f3990487d954cf45e98/users/4a51f21e0eca46e7a5941fe7bdcf9ae5/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.360097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f2ad2148aed4f3990487d954cf45e98, user_id=4a51f21e0eca46e7a5941fe7bdcf9ae5, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.362663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.433896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1156/2313] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:40:12 2022] PUT /identity/v3/projects/6f2ad2148aed4f3990487d954cf45e98/users/4a51f21e0eca46e7a5941fe7bdcf9ae5/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:12.445273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937c72-c28c-4dfd-98ef-c638ab33541b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.445592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937c72-c28c-4dfd-98ef-c638ab33541b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.445858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937c72-c28c-4dfd-98ef-c638ab33541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.472964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d6937c72-c28c-4dfd-98ef-c638ab33541b None None] MFA Rules not processed for user `4a51f21e0eca46e7a5941fe7bdcf9ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:12.474175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d6937c72-c28c-4dfd-98ef-c638ab33541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:12.536735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1158/2314] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:40:12.542321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.603735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be500c-0dfd-426b-bd67-610e05784b84 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.608477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.609053 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.609331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.609607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.610338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.612219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.700193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1157/2315] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:40:12 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:12.704226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937c72-c28c-4dfd-98ef-c638ab33541b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.714739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937c72-c28c-4dfd-98ef-c638ab33541b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.770578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.771304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.771615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.771979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.772670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.774744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.871025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1159/2316] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:40:12 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:40:12.874870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.885218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa5a7a-13e7-4d5e-ba1c-291fe50be34d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.889825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.890482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.890764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.891041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.891801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.893403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:12.903936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1158/2317] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:12.907899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:12.918406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1ff7c-411a-4cc2-b7a7-98d92ac6a2a1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:12.922999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:12.923896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:12.924205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:12.924476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] PATH_INFO: `/v3/projects/23e1070ca568469c9175d997d58839c4/users/4dfbbcd7354c4c6fb9197daa6f67fddc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:12.940189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e1070ca568469c9175d997d58839c4, user_id=4dfbbcd7354c4c6fb9197daa6f67fddc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:12.942840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:13.031260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1160/2318] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:40:12 2022] PUT /identity/v3/projects/23e1070ca568469c9175d997d58839c4/users/4dfbbcd7354c4c6fb9197daa6f67fddc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:13.035174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:13.045774 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31944add-96a8-4bb1-ad09-4c4eef87ebfd admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:13.099844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953ab11-2593-4084-851d-e81aab92671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:13.100510 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953ab11-2593-4084-851d-e81aab92671a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:13.100792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953ab11-2593-4084-851d-e81aab92671a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:13.101076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953ab11-2593-4084-851d-e81aab92671a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:13.101860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953ab11-2593-4084-851d-e81aab92671a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:13.104210 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953ab11-2593-4084-851d-e81aab92671a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:13.113831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1159/2319] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:40:13.118520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:13.128778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c03933-2e47-46b8-8370-827207e4e79f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:13.133920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:13.134789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:13.135071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:13.135382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] PATH_INFO: `/v3/projects/23e1070ca568469c9175d997d58839c4/users/4dfbbcd7354c4c6fb9197daa6f67fddc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:13.137356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23e1070ca568469c9175d997d58839c4, user_id=4dfbbcd7354c4c6fb9197daa6f67fddc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:13.140025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:13.150184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1161/2320] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:40:13 2022] PUT /identity/v3/projects/23e1070ca568469c9175d997d58839c4/users/4dfbbcd7354c4c6fb9197daa6f67fddc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:40:13.160216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:13.160506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:13.160785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:13.186973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] MFA Rules not processed for user `4dfbbcd7354c4c6fb9197daa6f67fddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:40:13.188187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:13.253111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1160/2321] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:40:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:40:22.688004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:40:22.689814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:22.747023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17599e5e-b59b-4a2d-af38-908a2607b067 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:40:22.750625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:40:22.751299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:40:22.751590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:40:22.751867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:40:22.753718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:40:22.762999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:40:22.764510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:40:22.772225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1162/2322] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:40:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:41:41.381983 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:41.383487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:41.451463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf9d3a-2a79-4f25-aa87-6dada5d2d341 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:41.456087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831860a-2744-4240-965c-040f667e060b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:41.456955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831860a-2744-4240-965c-040f667e060b service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:41.457272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831860a-2744-4240-965c-040f667e060b service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:41.457722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831860a-2744-4240-965c-040f667e060b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:41.460029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f831860a-2744-4240-965c-040f667e060b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:41.545113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831860a-2744-4240-965c-040f667e060b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:41.546549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831860a-2744-4240-965c-040f667e060b service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:41.565236 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1161/2323] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:41:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:41:41.613567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:41.622750 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a1e70-33dc-4af9-82cd-cffd90275792 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:41.626455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:41.630457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:41.630457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:41.630457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:41.636868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:41.638511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:41.648939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1163/2324] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:41:41 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:41:41.903928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831860a-2744-4240-965c-040f667e060b service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:41.905313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f831860a-2744-4240-965c-040f667e060b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:41.917388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831860a-2744-4240-965c-040f667e060b service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:41.921359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:41.922005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:41.922322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:41.922604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:41.924721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:41.987628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:41.989066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:41.998742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1162/2325] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:41:45.679968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:45.681492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:45.697025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406d1c-b024-4d6f-b155-c3bb30ebdac0 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:45.701623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:45.702482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:45.702767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:45.703043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] PATH_INFO: `/v3/users/dc411f6a0a024e7eac561ad1b6d2a944` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:45.704458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc411f6a0a024e7eac561ad1b6d2a944)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:45.706362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:45.849000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc411f6a0a024e7eac561ad1b6d2a944'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:45.910058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc411f6a0a024e7eac561ad1b6d2a944'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:45.923058 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc411f6a0a024e7eac561ad1b6d2a944'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:45.923830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc411f6a0a024e7eac561ad1b6d2a944'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:45.930457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2e3143b7-9306-4a4b-bf1c-0f99a207ecc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc411f6a0a024e7eac561ad1b6d2a944'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:45.936371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1164/2326] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:41:45 2022] DELETE /identity/v3/users/dc411f6a0a024e7eac561ad1b6d2a944 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:41:46.174278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:46.184307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba278ba4-b339-4714-a330-dcf7b46e7f10 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:46.243418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:46.244324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.244609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.244888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] PATH_INFO: `/v3/projects/bd946455713e4c36a8efadbce486ee8b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.259099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd946455713e4c36a8efadbce486ee8b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:46.262955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:46.368175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd946455713e4c36a8efadbce486ee8b', 'request_id': 'req-0e649dd3-d8a0-49f7-9533-906d415750cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:46.442861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd946455713e4c36a8efadbce486ee8b', 'request_id': 'req-0e649dd3-d8a0-49f7-9533-906d415750cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:46.448412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd946455713e4c36a8efadbce486ee8b', 'request_id': 'req-0e649dd3-d8a0-49f7-9533-906d415750cf'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:46.460404 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] The token cache is being invalidate because project bd946455713e4c36a8efadbce486ee8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:41:46.460693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:46.461322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e649dd3-d8a0-49f7-9533-906d415750cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:41:46.462851 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1163/2327] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:41:46 2022] DELETE /identity/v3/projects/bd946455713e4c36a8efadbce486ee8b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:41:46.469567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf58e-6ab7-428a-a8f9-2640b95c6113 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.475660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf58e-6ab7-428a-a8f9-2640b95c6113 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.475660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8abf58e-6ab7-428a-a8f9-2640b95c6113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.488713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b8abf58e-6ab7-428a-a8f9-2640b95c6113 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:41:46.489982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b8abf58e-6ab7-428a-a8f9-2640b95c6113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:46.549823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1165/2328] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:41:46.557731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad2ecf-0723-47dc-85e1-bb1c0d167409 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.558018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad2ecf-0723-47dc-85e1-bb1c0d167409 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.558338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad2ecf-0723-47dc-85e1-bb1c0d167409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.575567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7bad2ecf-0723-47dc-85e1-bb1c0d167409 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:41:46.576749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7bad2ecf-0723-47dc-85e1-bb1c0d167409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:46.584761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1164/2329] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:41:46.588666 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf58e-6ab7-428a-a8f9-2640b95c6113 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:46.599233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8abf58e-6ab7-428a-a8f9-2640b95c6113 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:46.603822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:46.604478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.604767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.605043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.605774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:41:46.606080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:46.607715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:46.619864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1166/2330] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:41:46.624171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad2ecf-0723-47dc-85e1-bb1c0d167409 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:46.633222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad2ecf-0723-47dc-85e1-bb1c0d167409 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:46.637836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:46.638475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.638758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.639036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.639772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:46.641946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:46.733992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1165/2331] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:41:46 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:41:46.738784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:46.749166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f8fe-9ec5-4323-8a2e-a2e3d8a5fee7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:46.803778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:46.804436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.804715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.804984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.805661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:46.807595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:46.904325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1167/2332] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:41:46 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:41:46.909036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:46.919454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da4af1-79f8-418e-a48b-a8a1970544b8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:46.924283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:46.924938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.925224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.925505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.926269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:46.927921 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:46.937769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1166/2333] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:41:46.941826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:46.951647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372ef32-93d1-41ac-8155-4052f70f871b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:46.956816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2855c1-9778-4cd2-80e7-0463df734761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:46.957467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2855c1-9778-4cd2-80e7-0463df734761 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.957755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2855c1-9778-4cd2-80e7-0463df734761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.958035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2855c1-9778-4cd2-80e7-0463df734761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:46.958824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2855c1-9778-4cd2-80e7-0463df734761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:46.960462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2855c1-9778-4cd2-80e7-0463df734761 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:46.971069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1168/2334] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:41:46.975049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:46.984758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed7cfd-2160-4516-9c8d-adb5273902c9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:46.989780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:46.990643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:46.990928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:46.991233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] PATH_INFO: `/v3/projects/1952b64dd5b540a589eec795a0b65df1/users/fae3e1cd45de449f8564b20df4ccf5a6/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.005413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1952b64dd5b540a589eec795a0b65df1, user_id=fae3e1cd45de449f8564b20df4ccf5a6, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:47.008107 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:47.115757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1167/2335] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:41:46 2022] PUT /identity/v3/projects/1952b64dd5b540a589eec795a0b65df1/users/fae3e1cd45de449f8564b20df4ccf5a6/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:41:47.127159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67e6eb-6f7d-4247-bb9d-c7cb1e9fc2ca None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.133882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67e6eb-6f7d-4247-bb9d-c7cb1e9fc2ca None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.133882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d67e6eb-6f7d-4247-bb9d-c7cb1e9fc2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.155203 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1d67e6eb-6f7d-4247-bb9d-c7cb1e9fc2ca None None] MFA Rules not processed for user `fae3e1cd45de449f8564b20df4ccf5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:41:47.156528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1d67e6eb-6f7d-4247-bb9d-c7cb1e9fc2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:47.221008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1169/2336] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:41:47.225517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:47.286322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f37bc3-95a3-498d-8a3e-192b98fa1e92 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:47.291033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:47.291712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.291996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.292271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.292955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:47.294864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:47.421602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1168/2337] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:41:47 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:41:47.426434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67e6eb-6f7d-4247-bb9d-c7cb1e9fc2ca None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:47.436826 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d67e6eb-6f7d-4247-bb9d-c7cb1e9fc2ca None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:47.493647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:47.494233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.494516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.494793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.495524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:47.497536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:47.609524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1170/2338] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:41:47 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:41:47.613801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:47.624306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f78f6-2f38-42ca-a1cd-91b738875c74 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:47.629488 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:47.630141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.630458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.630994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.631764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:47.633376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:47.644686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1169/2339] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:41:47.648684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:47.658937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93f9c3-eb06-4251-9365-5263232cf706 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:47.663388 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:47.664244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.664523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.664821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] PATH_INFO: `/v3/projects/ae746da385784e78a9939a483196a1da/users/3fd6cf2d81c74b06a0c62f9867b53bf2/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.679321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae746da385784e78a9939a483196a1da, user_id=3fd6cf2d81c74b06a0c62f9867b53bf2, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:47.681970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:47.757934 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1171/2340] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:41:47 2022] PUT /identity/v3/projects/ae746da385784e78a9939a483196a1da/users/3fd6cf2d81c74b06a0c62f9867b53bf2/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:41:47.761868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:47.772292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432e3f4-468d-46a8-8621-e95e53985d99 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:47.826440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ac809-96b7-4c1f-b259-3a7cb1cf5437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:47.827133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac809-96b7-4c1f-b259-3a7cb1cf5437 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.827408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac809-96b7-4c1f-b259-3a7cb1cf5437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.827684 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ac809-96b7-4c1f-b259-3a7cb1cf5437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.829020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac809-96b7-4c1f-b259-3a7cb1cf5437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:47.830792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ac809-96b7-4c1f-b259-3a7cb1cf5437 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:47.840300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1170/2341] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:41:47.847562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:47.857870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6930f7-e45b-4c20-9284-cebe3a92dae1 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:47.862519 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:47.863432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.863716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.864047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] PATH_INFO: `/v3/projects/ae746da385784e78a9939a483196a1da/users/3fd6cf2d81c74b06a0c62f9867b53bf2/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.866015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae746da385784e78a9939a483196a1da, user_id=3fd6cf2d81c74b06a0c62f9867b53bf2, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:47.868671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:47.878842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1172/2342] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:41:47 2022] PUT /identity/v3/projects/ae746da385784e78a9939a483196a1da/users/3fd6cf2d81c74b06a0c62f9867b53bf2/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:41:47.888881 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe26964-5e42-4a4d-85ee-ac25e5c075e8 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:47.889171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe26964-5e42-4a4d-85ee-ac25e5c075e8 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:47.889451 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe26964-5e42-4a4d-85ee-ac25e5c075e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:47.917052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7fe26964-5e42-4a4d-85ee-ac25e5c075e8 None None] MFA Rules not processed for user `3fd6cf2d81c74b06a0c62f9867b53bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:41:47.918255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7fe26964-5e42-4a4d-85ee-ac25e5c075e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:47.985504 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1171/2343] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:41:59.176211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:59.177908 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:59.234982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e903719-8bb1-4fff-9965-7f3d38be0411 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:59.239036 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:59.239705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:59.239989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:59.240287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:59.242210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:41:59.298273 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:59.299714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:59.308419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1173/2344] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:41:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:41:59.352922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe26964-5e42-4a4d-85ee-ac25e5c075e8 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:41:59.362308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe26964-5e42-4a4d-85ee-ac25e5c075e8 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:41:59.365785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:41:59.366416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:41:59.366695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:41:59.366967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:41:59.375794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:41:59.377906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:41:59.387060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1172/2345] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:41:59 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:31.963296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:31.964684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:32.068401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871b725-fc2f-4aeb-80d7-34a473b5f2bd service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:32.073478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:32.074148 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:32.074429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:32.075260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:32.077116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:32.088360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:32.089914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:32.100434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1174/2346] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:42.471309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:42.472722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:42.512802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a172b-6f1d-47e3-9f1b-9b665ba38bc1 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:42.516564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:42.517187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:42.517464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:42.517733 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:42.519471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:42.574769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:42.576453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:42.584869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1173/2347] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:42.966605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:42.986326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fd2d3-c14a-4719-a4ae-7ae966652eb5 service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:42.989955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:42.990589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:42.990865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:42.991164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:42.992930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:43.075968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:43.078183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:43.096674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1175/2348] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:54.122847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:54.131471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535eb4d-f728-4bfe-84a7-af0c3436e347 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:54.135057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d89e0c-f2ff-4461-9971-5f5805b43b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:54.135724 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89e0c-f2ff-4461-9971-5f5805b43b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:54.136006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89e0c-f2ff-4461-9971-5f5805b43b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:54.136277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d89e0c-f2ff-4461-9971-5f5805b43b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:54.138010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e3d89e0c-f2ff-4461-9971-5f5805b43b03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:54.211799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d89e0c-f2ff-4461-9971-5f5805b43b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:54.213253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d89e0c-f2ff-4461-9971-5f5805b43b03 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:54.225638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1174/2349] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:55.057601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:55.131988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35249b-1c83-4e09-80ad-9f7485284f9c service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:55.143771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:55.143771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:55.143771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:55.143771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] PATH_INFO: `/v3/users/fae3e1cd45de449f8564b20df4ccf5a6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:55.144230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae3e1cd45de449f8564b20df4ccf5a6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:55.144230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:55.352183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae3e1cd45de449f8564b20df4ccf5a6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:55.412334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae3e1cd45de449f8564b20df4ccf5a6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:55.424160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae3e1cd45de449f8564b20df4ccf5a6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:55.425526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae3e1cd45de449f8564b20df4ccf5a6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:55.432311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae3e1cd45de449f8564b20df4ccf5a6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:55.438660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1176/2350] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:43:55 2022] DELETE /identity/v3/users/fae3e1cd45de449f8564b20df4ccf5a6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:43:55.443142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:55.447254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:55.447254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:55.461114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:43:55.462378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:55.520924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1175/2351] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:43:55.531149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:55.532581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:55.591872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eae986-d1ca-4374-8d02-b6007732e5c2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:55.596017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:55.597535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:55.597828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:55.598179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:55.612993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:55.614362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:55.624148 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1177/2352] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:56.064819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:56.067466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:56.079696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa35be2-3a70-4ee0-8d74-86d990e22e24 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:56.087171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:56.089386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:56.089386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:56.089386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] PATH_INFO: `/v3/projects/1952b64dd5b540a589eec795a0b65df1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:56.090313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1952b64dd5b540a589eec795a0b65df1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:56.091722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:56.224366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1952b64dd5b540a589eec795a0b65df1', 'request_id': 'req-6d2d13c5-1072-48da-b934-e0a4f5fa645d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.321004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1952b64dd5b540a589eec795a0b65df1', 'request_id': 'req-6d2d13c5-1072-48da-b934-e0a4f5fa645d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.327087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1952b64dd5b540a589eec795a0b65df1', 'request_id': 'req-6d2d13c5-1072-48da-b934-e0a4f5fa645d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.338853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] The token cache is being invalidate because project 1952b64dd5b540a589eec795a0b65df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:43:56.342087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.342087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.342087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1176/2353] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:43:56 2022] DELETE /identity/v3/projects/1952b64dd5b540a589eec795a0b65df1 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:43:56.345832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:56.355968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65594e49-d61e-4cbe-9fb9-145f326b45d3 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:56.411470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:56.412260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:56.412581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:56.412862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] PATH_INFO: `/v3/users/3fd6cf2d81c74b06a0c62f9867b53bf2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:56.414080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd6cf2d81c74b06a0c62f9867b53bf2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:56.416077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:56.629660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd6cf2d81c74b06a0c62f9867b53bf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.697842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd6cf2d81c74b06a0c62f9867b53bf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.710096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd6cf2d81c74b06a0c62f9867b53bf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.710732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd6cf2d81c74b06a0c62f9867b53bf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.717521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ad6223c2-32de-458f-8fcb-5da128ce6b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd6cf2d81c74b06a0c62f9867b53bf2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:56.723912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1178/2354] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:43:56 2022] DELETE /identity/v3/users/3fd6cf2d81c74b06a0c62f9867b53bf2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:43:57.082109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:57.083615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:57.099961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d13c5-1072-48da-b934-e0a4f5fa645d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:57.156260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:57.157124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.157405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.157683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] PATH_INFO: `/v3/projects/ae746da385784e78a9939a483196a1da` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.159541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae746da385784e78a9939a483196a1da)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:57.161654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:57.262855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae746da385784e78a9939a483196a1da', 'request_id': 'req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:57.309160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae746da385784e78a9939a483196a1da', 'request_id': 'req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:57.314677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae746da385784e78a9939a483196a1da', 'request_id': 'req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:57.325601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] The token cache is being invalidate because project ae746da385784e78a9939a483196a1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:43:57.325897 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:57.326517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8e8d6b81-5381-42e7-bdfc-ca33f857a8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:43:57.328088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1177/2355] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:43:57 2022] DELETE /identity/v3/projects/ae746da385784e78a9939a483196a1da => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:43:57.333559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185be9-6b7e-4580-b012-5b15c5b57387 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.333852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185be9-6b7e-4580-b012-5b15c5b57387 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.334131 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e185be9-6b7e-4580-b012-5b15c5b57387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.352387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6e185be9-6b7e-4580-b012-5b15c5b57387 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:43:57.353593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6e185be9-6b7e-4580-b012-5b15c5b57387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:57.411442 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1179/2356] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:43:57.420063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5920eeb-5e09-4105-aada-2d787a2aba4d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.420351 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5920eeb-5e09-4105-aada-2d787a2aba4d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.420629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5920eeb-5e09-4105-aada-2d787a2aba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.438777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d5920eeb-5e09-4105-aada-2d787a2aba4d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:43:57.440021 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d5920eeb-5e09-4105-aada-2d787a2aba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:57.447949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1178/2357] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:43:57.452138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e185be9-6b7e-4580-b012-5b15c5b57387 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:57.463092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e185be9-6b7e-4580-b012-5b15c5b57387 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:57.467919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:57.468822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.469109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.469389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.470121 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:43:57.470434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:57.472862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:57.485520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1180/2358] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:43:57.490109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5920eeb-5e09-4105-aada-2d787a2aba4d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:57.499137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5920eeb-5e09-4105-aada-2d787a2aba4d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:57.503793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:57.504434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.504712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.504982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.505674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:57.507580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:57.620173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1179/2359] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:43:57 2022] POST /identity/v3/projects => generated 361 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:43:57.624292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:57.635311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb22c7-b8d4-406a-8c55-cbb3b76b5036 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:57.704024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:57.704643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.704935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.705222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.706640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:57.708717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:57.772983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1181/2360] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:43:57 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:43:57.777157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:57.787771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4885ad-42d7-4c25-9a2c-bed7443b5e0b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:57.792439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:57.793097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.793380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.793720 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.794448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:57.796206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:57.806869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1180/2361] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:43:57.810894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:57.821420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffdffbf-445e-4c0d-8ff7-f1163e72a6a8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:57.825965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5cd7e0-39eb-40b1-adca-4fce40e3a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:57.826596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd7e0-39eb-40b1-adca-4fce40e3a647 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.826882 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd7e0-39eb-40b1-adca-4fce40e3a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.827258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5cd7e0-39eb-40b1-adca-4fce40e3a647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.827995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cd7e0-39eb-40b1-adca-4fce40e3a647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:57.829589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5cd7e0-39eb-40b1-adca-4fce40e3a647 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:57.844134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1182/2362] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:43:57.845244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:57.855289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594b3f0-4d69-40fb-af7f-db30cc69d97e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:57.860180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:57.861065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.861353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.861731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] PATH_INFO: `/v3/projects/37e57bde1b0c44ea9a10c5600e7146db/users/857762657c8941c3b93ba91775686c9b/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.878331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37e57bde1b0c44ea9a10c5600e7146db, user_id=857762657c8941c3b93ba91775686c9b, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:57.880930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:57.958216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1181/2363] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:43:57 2022] PUT /identity/v3/projects/37e57bde1b0c44ea9a10c5600e7146db/users/857762657c8941c3b93ba91775686c9b/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:43:57.961359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98d035-1170-4de2-a672-48ae0104ed36 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:57.961723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98d035-1170-4de2-a672-48ae0104ed36 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:57.962071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98d035-1170-4de2-a672-48ae0104ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:57.992285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bd98d035-1170-4de2-a672-48ae0104ed36 None None] MFA Rules not processed for user `857762657c8941c3b93ba91775686c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:43:57.993522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bd98d035-1170-4de2-a672-48ae0104ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:58.060070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1183/2364] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:43:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:43:58.064731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:58.137028 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648b9b6-ee5e-426b-9967-754e833ff482 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:58.142804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:58.144402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.144698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.144975 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.145696 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:58.149665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:58.255303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1182/2365] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:43:58 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:43:58.258962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98d035-1170-4de2-a672-48ae0104ed36 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:58.270007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98d035-1170-4de2-a672-48ae0104ed36 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:58.324613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:58.325274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.325616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.325891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.326572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:58.328528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:58.423632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1184/2366] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:43:58 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:43:58.427860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:58.441874 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641d319-664e-4409-b250-a55bfeec59da admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:58.445899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:58.446747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:58.447456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.453003 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:58.453160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.453160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.453160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:58.453160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:58.462102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1183/2367] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:43:58.466372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:58.476264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd33564-8391-462e-9a6b-95a999f5d0f6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:58.483603 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:58.484608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.484886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.485160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] PATH_INFO: `/v3/projects/fc0e7e4164264bc48626abff138f3eb5/users/5052c0083f65496aa6d89056064a7483/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.504224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0e7e4164264bc48626abff138f3eb5, user_id=5052c0083f65496aa6d89056064a7483, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:58.509178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:58.533438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e958a5-201b-4bbd-8466-067b5342d590 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:58.539582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:58.540242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.540544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.540810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.542632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:58.555490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:58.557140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:58.569538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1185/2368] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:58.581777 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1184/2369] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:43:58 2022] PUT /identity/v3/projects/fc0e7e4164264bc48626abff138f3eb5/users/5052c0083f65496aa6d89056064a7483/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:43:58.582915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:58.594262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947fc4a-e432-4aff-81d9-21d029b2d910 service nova] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:58.678584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa19603-e1cc-4cac-9ee7-55ed2ef1ceae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:58.679296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19603-e1cc-4cac-9ee7-55ed2ef1ceae admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.679581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19603-e1cc-4cac-9ee7-55ed2ef1ceae admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.679861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa19603-e1cc-4cac-9ee7-55ed2ef1ceae admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.680593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa19603-e1cc-4cac-9ee7-55ed2ef1ceae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:58.682195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa19603-e1cc-4cac-9ee7-55ed2ef1ceae admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:58.692386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1186/2370] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:43:58.701034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:58.712949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917c192-ac23-4f37-a8df-637ced6b44ac admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:58.724073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:58.724982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.725270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.725549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] PATH_INFO: `/v3/projects/fc0e7e4164264bc48626abff138f3eb5/users/5052c0083f65496aa6d89056064a7483/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.730030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0e7e4164264bc48626abff138f3eb5, user_id=5052c0083f65496aa6d89056064a7483, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:58.732758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:58.747593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1185/2371] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:43:58 2022] PUT /identity/v3/projects/fc0e7e4164264bc48626abff138f3eb5/users/5052c0083f65496aa6d89056064a7483/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:43:58.758942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f3570-8b5b-4f04-87ce-ded14e1e8879 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:58.759380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f3570-8b5b-4f04-87ce-ded14e1e8879 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:58.759570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f3570-8b5b-4f04-87ce-ded14e1e8879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:58.791940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-995f3570-8b5b-4f04-87ce-ded14e1e8879 None None] MFA Rules not processed for user `5052c0083f65496aa6d89056064a7483`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:43:58.793369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-995f3570-8b5b-4f04-87ce-ded14e1e8879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:58.885381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1187/2372] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:43:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:43:59.296839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:59.298819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:43:59.358699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf160e-4bc1-4c46-b836-c3cf1591c010 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:59.362612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:59.363289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:59.363577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:59.363853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:59.373375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:59.374828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:59.389491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1186/2373] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:43:59.649210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f3570-8b5b-4f04-87ce-ded14e1e8879 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:43:59.662997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f3570-8b5b-4f04-87ce-ded14e1e8879 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:43:59.662997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae41553-f0a6-4ae9-9744-c75115e8c514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:43:59.663717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae41553-f0a6-4ae9-9744-c75115e8c514 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:43:59.664011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae41553-f0a6-4ae9-9744-c75115e8c514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:43:59.664288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae41553-f0a6-4ae9-9744-c75115e8c514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:43:59.731753 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae41553-f0a6-4ae9-9744-c75115e8c514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:43:59.733186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae41553-f0a6-4ae9-9744-c75115e8c514 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:43:59.742387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1188/2374] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:43:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:10.706695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:10.708191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:10.772491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e42e53-1f5f-4908-ac50-efa5b79818a5 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:10.776957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:10.777810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:10.778086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:10.778358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] PATH_INFO: `/v3/users/4a51f21e0eca46e7a5941fe7bdcf9ae5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:10.779646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a51f21e0eca46e7a5941fe7bdcf9ae5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:10.781543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:10.940055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a51f21e0eca46e7a5941fe7bdcf9ae5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:10.947282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a51f21e0eca46e7a5941fe7bdcf9ae5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:11.034665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a51f21e0eca46e7a5941fe7bdcf9ae5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:11.047401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a51f21e0eca46e7a5941fe7bdcf9ae5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:11.048092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a51f21e0eca46e7a5941fe7bdcf9ae5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:11.054131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1187/2375] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:10 2022] DELETE /identity/v3/users/4a51f21e0eca46e7a5941fe7bdcf9ae5 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:11.058866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:11.059413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:11.059683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:11.077322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:11.078630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:11.138659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1189/2376] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:11.149409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:11.150972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:11.225161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd4dc4-0664-4e0d-952d-878c06b99356 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:11.228869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:11.229511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:11.229789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:11.230059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:11.239082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:11.240542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:11.250007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1188/2377] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:11.847232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:11.852810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:11.861968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95355f36-4633-49e6-a859-4e152b7641a0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:11.868345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:11.869522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:11.869812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:11.870093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] PATH_INFO: `/v3/projects/6f2ad2148aed4f3990487d954cf45e98` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:11.871619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f2ad2148aed4f3990487d954cf45e98)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:11.875897 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:11.992909 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f2ad2148aed4f3990487d954cf45e98', 'request_id': 'req-b88147d6-93d9-48c9-b25b-090d5f803406'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.003864 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f2ad2148aed4f3990487d954cf45e98', 'request_id': 'req-b88147d6-93d9-48c9-b25b-090d5f803406'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.011745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f2ad2148aed4f3990487d954cf45e98', 'request_id': 'req-b88147d6-93d9-48c9-b25b-090d5f803406'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.091701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] The token cache is being invalidate because project 6f2ad2148aed4f3990487d954cf45e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:12.092346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.092731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.094678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1190/2378] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:11 2022] DELETE /identity/v3/projects/6f2ad2148aed4f3990487d954cf45e98 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:12.098766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:12.109296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687964f3-69bc-4da9-819a-4f32732c9f37 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:12.168177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:12.169237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:12.169525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:12.169801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] PATH_INFO: `/v3/users/4dfbbcd7354c4c6fb9197daa6f67fddc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:12.171066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfbbcd7354c4c6fb9197daa6f67fddc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:12.173054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:12.367318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfbbcd7354c4c6fb9197daa6f67fddc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.378781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfbbcd7354c4c6fb9197daa6f67fddc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.463518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfbbcd7354c4c6fb9197daa6f67fddc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.479889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfbbcd7354c4c6fb9197daa6f67fddc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.480822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-519d8bd0-cfda-44da-b043-7bf78d03ce50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfbbcd7354c4c6fb9197daa6f67fddc'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:12.487854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1189/2379] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:12 2022] DELETE /identity/v3/users/4dfbbcd7354c4c6fb9197daa6f67fddc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:12.983225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:12.984692 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:12.999268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88147d6-93d9-48c9-b25b-090d5f803406 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.068451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.069471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.069868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.070151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] PATH_INFO: `/v3/projects/23e1070ca568469c9175d997d58839c4` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.071405 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23e1070ca568469c9175d997d58839c4)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:13.073328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:13.177739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23e1070ca568469c9175d997d58839c4', 'request_id': 'req-dd44778d-80be-4412-92c1-969eb9e0c32d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.183787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23e1070ca568469c9175d997d58839c4', 'request_id': 'req-dd44778d-80be-4412-92c1-969eb9e0c32d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.189883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23e1070ca568469c9175d997d58839c4', 'request_id': 'req-dd44778d-80be-4412-92c1-969eb9e0c32d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.286444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] The token cache is being invalidate because project 23e1070ca568469c9175d997d58839c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:13.286901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.287885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.289888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1191/2380] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:12 2022] DELETE /identity/v3/projects/23e1070ca568469c9175d997d58839c4 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:13.295821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150e3b-23de-4045-b702-50e50bd69ae9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.296795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150e3b-23de-4045-b702-50e50bd69ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.297246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1150e3b-23de-4045-b702-50e50bd69ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.319613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e1150e3b-23de-4045-b702-50e50bd69ae9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:13.320781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e1150e3b-23de-4045-b702-50e50bd69ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:13.393433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.395064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:13.399241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1190/2381] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:13.408646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd44778d-80be-4412-92c1-969eb9e0c32d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.412171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfedad-362f-461f-91fd-0282bd1d9f72 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.412564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfedad-362f-461f-91fd-0282bd1d9f72 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.413019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfedad-362f-461f-91fd-0282bd1d9f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.415886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.416938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.417382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.417731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] PATH_INFO: `/v3/users/857762657c8941c3b93ba91775686c9b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.419436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] RBAC: Authorizing `identity:delete_user(user_id=857762657c8941c3b93ba91775686c9b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:13.421726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:13.431829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-74bfedad-362f-461f-91fd-0282bd1d9f72 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:13.433088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-74bfedad-362f-461f-91fd-0282bd1d9f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:13.443166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1191/2382] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:13.448791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfedad-362f-461f-91fd-0282bd1d9f72 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.460910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bfedad-362f-461f-91fd-0282bd1d9f72 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.467322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.468145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.468501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.469094 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.469816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:13.470122 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:13.471948 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:13.486023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1192/2383] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:44:13.491760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.501989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931df6-4731-4361-ae9d-b5789be22b87 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.512033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.514087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.514087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.514087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.514396 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:13.516243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:13.628993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1193/2384] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:13 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:13.635160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.689773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '857762657c8941c3b93ba91775686c9b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.711592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b307128-500e-4d0a-878b-34225365998e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.716600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.718930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.718930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.718930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.718930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:13.721066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:13.795027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '857762657c8941c3b93ba91775686c9b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.801580 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1194/2385] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:13 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:13.806456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.810182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '857762657c8941c3b93ba91775686c9b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.811038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '857762657c8941c3b93ba91775686c9b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.818240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370180b-8642-4c8a-8f4c-afcee3cb36c8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.820023 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9bfb56f2-103f-4a46-aa68-179ac93ddcae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '857762657c8941c3b93ba91775686c9b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:13.824489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.825694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.826150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.826604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.833494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:13.833646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1192/2386] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:13 2022] DELETE /identity/v3/users/857762657c8941c3b93ba91775686c9b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:13.833755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:13.837471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.837867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.838168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.841194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1195/2387] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:13.845240 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.846896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:13.857482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:13.859575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:13.862364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436025e-b2d1-4508-93e5-54afc094da6b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.929886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1193/2388] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:13.940129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.941984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:13.944799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.945553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.950075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.950075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.950075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:13.950075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:13.961329 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1196/2389] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:13.965473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:13.976434 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a55fbe-d925-4b37-93c4-9abe52b7bb4a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:13.981740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:13.982628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:13.982911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:13.983239 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] PATH_INFO: `/v3/projects/2c0bd824d8ab41ad82ae583e572f3c25/users/ee453e2552684d4ba7501658b49654d2/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:13.998057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c0bd824d8ab41ad82ae583e572f3c25, user_id=ee453e2552684d4ba7501658b49654d2, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.000799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.004017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437df4d-f5fc-4cdf-b5b6-9cbf404a80e3 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.008847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d6f22-72a8-4acf-bf39-6bcae0a336ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.009531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d6f22-72a8-4acf-bf39-6bcae0a336ed service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.009820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d6f22-72a8-4acf-bf39-6bcae0a336ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.010099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d6f22-72a8-4acf-bf39-6bcae0a336ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.019822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d6f22-72a8-4acf-bf39-6bcae0a336ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.021350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d6f22-72a8-4acf-bf39-6bcae0a336ed service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.032895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1194/2390] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:44:14.066467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1197/2391] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:13 2022] PUT /identity/v3/projects/2c0bd824d8ab41ad82ae583e572f3c25/users/ee453e2552684d4ba7501658b49654d2/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:14.079232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9c28-633c-405a-a358-c22e6bac1b40 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.079523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9c28-633c-405a-a358-c22e6bac1b40 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.079798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c9c28-633c-405a-a358-c22e6bac1b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.107974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a21c9c28-633c-405a-a358-c22e6bac1b40 None None] MFA Rules not processed for user `ee453e2552684d4ba7501658b49654d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:14.110727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a21c9c28-633c-405a-a358-c22e6bac1b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:14.179513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1195/2392] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:14.190110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.252642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4531f-1a56-4397-9811-fdedaf09425e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.257552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.258212 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.258493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.258765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.259501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.261414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.333967 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1198/2393] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:14 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:14.337989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9c28-633c-405a-a358-c22e6bac1b40 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.349156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c9c28-633c-405a-a358-c22e6bac1b40 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.406550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.407283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.407606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.408029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.408617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.410765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.501127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1196/2394] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:14 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:14.503501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.515000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f5b1-69f2-4c3c-a7db-446d6052485e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.521850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.522772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.523114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.527303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.527303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.527303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.539511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1199/2395] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:14.544172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.562189 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.564158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d15aa5-1344-4fb6-a89d-ca4e72dacd6d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.565047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:14.580091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.580959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.581337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.582535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.583862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.586012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6de8-d5f6-4da0-88c5-f475be1c811f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.586171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.591423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.592291 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.592605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.592884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] PATH_INFO: `/v3/projects/37e57bde1b0c44ea9a10c5600e7146db` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.594643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37e57bde1b0c44ea9a10c5600e7146db)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.596727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.599535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1197/2396] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:14.609930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.621643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77731db-ca12-447f-9b63-187a73c18088 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.627760 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672923f-c8cb-44cb-aa67-2a205274fa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.628889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672923f-c8cb-44cb-aa67-2a205274fa1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.629166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672923f-c8cb-44cb-aa67-2a205274fa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.629445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672923f-c8cb-44cb-aa67-2a205274fa1c admin admin] PATH_INFO: `/v3/projects/c033d11f274745548798b78c9da45d25/users/d08e23341424448aaacd2b3210508915/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.645559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672923f-c8cb-44cb-aa67-2a205274fa1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c033d11f274745548798b78c9da45d25, user_id=d08e23341424448aaacd2b3210508915, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.649076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672923f-c8cb-44cb-aa67-2a205274fa1c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.733536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1198/2397] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:14 2022] PUT /identity/v3/projects/c033d11f274745548798b78c9da45d25/users/d08e23341424448aaacd2b3210508915/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:14.744281 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e322b-3c16-48f4-ac58-a187b31ae633 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.744746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e322b-3c16-48f4-ac58-a187b31ae633 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.745092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e322b-3c16-48f4-ac58-a187b31ae633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.749941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37e57bde1b0c44ea9a10c5600e7146db', 'request_id': 'req-62e852f3-9617-4c23-bdd6-8d4172391c87'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:14.773320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-033e322b-3c16-48f4-ac58-a187b31ae633 None None] MFA Rules not processed for user `d08e23341424448aaacd2b3210508915`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:14.774676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-033e322b-3c16-48f4-ac58-a187b31ae633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:14.817701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37e57bde1b0c44ea9a10c5600e7146db', 'request_id': 'req-62e852f3-9617-4c23-bdd6-8d4172391c87'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:14.825753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37e57bde1b0c44ea9a10c5600e7146db', 'request_id': 'req-62e852f3-9617-4c23-bdd6-8d4172391c87'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:14.838715 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] The token cache is being invalidate because project 37e57bde1b0c44ea9a10c5600e7146db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:14.839001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:14.839699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:14.841729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1200/2398] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:14 2022] DELETE /identity/v3/projects/37e57bde1b0c44ea9a10c5600e7146db => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:14.842343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1199/2399] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:14.847384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e322b-3c16-48f4-ac58-a187b31ae633 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.847548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:14.848894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:14.910946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e322b-3c16-48f4-ac58-a187b31ae633 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.915276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e852f3-9617-4c23-bdd6-8d4172391c87 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:14.916271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.917073 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.917542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.917906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.918650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.920657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:14.920824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:14.925417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:14.925797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:14.926226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] PATH_INFO: `/v3/users/5052c0083f65496aa6d89056064a7483` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:14.928342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5052c0083f65496aa6d89056064a7483)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:14.932711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.002972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1200/2400] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:14 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:15.002972 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:15.004032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:15.074254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ea56e-a8d0-48fb-8917-8d23fbc4644a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:15.079592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:15.080380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.080641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.080956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.081723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:15.083707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.094270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5052c0083f65496aa6d89056064a7483'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:15.101704 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5052c0083f65496aa6d89056064a7483'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:15.155793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1201/2401] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:15 2022] POST /identity/v3/users => generated 299 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:15.165156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:15.176680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d1d773-677a-4cce-b13c-98ab0134af7d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:15.183726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:15.184539 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.184832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.185104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.185963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:15.187784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.197780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1202/2402] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:44:15.202118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:15.206505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5052c0083f65496aa6d89056064a7483'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:15.212308 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee90eab-e613-41ca-8443-cca6c18d736a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:15.217326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:15.218201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.218484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.219017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] PATH_INFO: `/v3/projects/8c0088f85e1f49fa81b6f7b4ca2da13a/users/2d832c2477cd4df18b483f5be7979c02/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.221863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5052c0083f65496aa6d89056064a7483'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:15.222690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5052c0083f65496aa6d89056064a7483'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:15.229543 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1201/2403] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:14 2022] DELETE /identity/v3/users/5052c0083f65496aa6d89056064a7483 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:15.235397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0088f85e1f49fa81b6f7b4ca2da13a, user_id=2d832c2477cd4df18b483f5be7979c02, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:15.238057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.338532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1203/2404] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:15 2022] PUT /identity/v3/projects/8c0088f85e1f49fa81b6f7b4ca2da13a/users/2d832c2477cd4df18b483f5be7979c02/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:15.342686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:15.344499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:15.409712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eab6a0-fb7e-4da5-8057-7ec4ff26b301 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:15.476024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb7ee4-3ec9-48ab-9c17-d2ac5bdf66f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:15.476024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb7ee4-3ec9-48ab-9c17-d2ac5bdf66f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.476024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb7ee4-3ec9-48ab-9c17-d2ac5bdf66f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.476024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb7ee4-3ec9-48ab-9c17-d2ac5bdf66f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.477355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb7ee4-3ec9-48ab-9c17-d2ac5bdf66f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:15.478102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb7ee4-3ec9-48ab-9c17-d2ac5bdf66f8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.489229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1202/2405] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:15.494847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:15.510374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801da9c5-70a5-4f21-8bf6-440695cd55a4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:15.515172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:15.516061 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.516340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.516614 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] PATH_INFO: `/v3/projects/8c0088f85e1f49fa81b6f7b4ca2da13a/users/2d832c2477cd4df18b483f5be7979c02/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.518611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0088f85e1f49fa81b6f7b4ca2da13a, user_id=2d832c2477cd4df18b483f5be7979c02, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:15.521427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.532252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1204/2406] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:15 2022] PUT /identity/v3/projects/8c0088f85e1f49fa81b6f7b4ca2da13a/users/2d832c2477cd4df18b483f5be7979c02/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:15.544757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.545066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.545677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.579904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] MFA Rules not processed for user `2d832c2477cd4df18b483f5be7979c02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:15.583253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:15.664340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1203/2407] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:15.675155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:15.677009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:15.687761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:15.689334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:15.756610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7270552-190c-4d62-a715-5e83d76c0b40 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:15.760355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f538035-68d8-4a2e-8b1f-7f81d54c4f5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:15.761054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538035-68d8-4a2e-8b1f-7f81d54c4f5d service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.766277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538035-68d8-4a2e-8b1f-7f81d54c4f5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.766277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f538035-68d8-4a2e-8b1f-7f81d54c4f5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.770665 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538035-68d8-4a2e-8b1f-7f81d54c4f5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:15.771522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1fbaab-4c72-4010-9f59-7ca45370900f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:15.772566 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f538035-68d8-4a2e-8b1f-7f81d54c4f5d service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.776604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:15.777467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:15.777753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:15.778032 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] PATH_INFO: `/v3/projects/fc0e7e4164264bc48626abff138f3eb5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:15.779265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0e7e4164264bc48626abff138f3eb5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:15.781192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:15.782373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1205/2408] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:15.886577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0e7e4164264bc48626abff138f3eb5', 'request_id': 'req-bd9faaeb-9f02-4701-a80c-ed81b53608ef'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:15.983302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0e7e4164264bc48626abff138f3eb5', 'request_id': 'req-bd9faaeb-9f02-4701-a80c-ed81b53608ef'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:15.989219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0e7e4164264bc48626abff138f3eb5', 'request_id': 'req-bd9faaeb-9f02-4701-a80c-ed81b53608ef'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:16.001392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] The token cache is being invalidate because project fc0e7e4164264bc48626abff138f3eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:16.001619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:16.002288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-bd9faaeb-9f02-4701-a80c-ed81b53608ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:16.008420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1204/2409] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:15 2022] DELETE /identity/v3/projects/fc0e7e4164264bc48626abff138f3eb5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:16.012464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff97d-ec08-45d6-99cf-f39b1004f10c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.012464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff97d-ec08-45d6-99cf-f39b1004f10c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.012464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ff97d-ec08-45d6-99cf-f39b1004f10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.032172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1d9ff97d-ec08-45d6-99cf-f39b1004f10c None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:16.033593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1d9ff97d-ec08-45d6-99cf-f39b1004f10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:16.097142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1206/2410] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:16.106952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8992-d844-4a24-9833-bb9a13eb8323 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.107375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8992-d844-4a24-9833-bb9a13eb8323 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.107619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be8992-d844-4a24-9833-bb9a13eb8323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.128406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-92be8992-d844-4a24-9833-bb9a13eb8323 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:16.129691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-92be8992-d844-4a24-9833-bb9a13eb8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:16.139538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1205/2411] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:16.143437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ff97d-ec08-45d6-99cf-f39b1004f10c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.152888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ff97d-ec08-45d6-99cf-f39b1004f10c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.157464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.158117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.158400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.158730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.159510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:16.159814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.161409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.177876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1207/2412] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:44:16.179943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be8992-d844-4a24-9833-bb9a13eb8323 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.190613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be8992-d844-4a24-9833-bb9a13eb8323 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.196637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.197303 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.197625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.197865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.198686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.206412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.219891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.221963 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:16.281176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94257e23-1451-4a5a-a56c-f883c6344e3e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.284720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.285357 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.285637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.285911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.288226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:16.300561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.302002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.309904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1206/2413] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:16 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:16.311104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.313271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1208/2414] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:44:16.378530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd6e464-b610-45f6-b9f6-ff2693702a37 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.385731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.386416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.386697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.387184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.387949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.390085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.464131 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1207/2415] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:16 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:16.468007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.480565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccaac50-0ad4-4fe1-b00e-4c40eacb6afe service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.487284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.490056 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.490462 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.491394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.492217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.494794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.505761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1209/2416] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:16.510423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.520561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec929339-4566-454f-8ac4-aa61b63ac02e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.525410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabdc739-4bc9-4cb6-9fcc-4e4f82cbc87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.526073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc739-4bc9-4cb6-9fcc-4e4f82cbc87b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.526355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc739-4bc9-4cb6-9fcc-4e4f82cbc87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.526632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabdc739-4bc9-4cb6-9fcc-4e4f82cbc87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.527395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc739-4bc9-4cb6-9fcc-4e4f82cbc87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.529007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabdc739-4bc9-4cb6-9fcc-4e4f82cbc87b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.547169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1208/2417] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:44:16.547361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.556180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c0a59-83f4-48be-9c23-104510ccca3e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.560872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.561747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.562027 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.562299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] PATH_INFO: `/v3/projects/0c953a6495b04f09837d97f339848c7a/users/2a8929a38d194edbba61909f12ff2834/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.585419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c953a6495b04f09837d97f339848c7a, user_id=2a8929a38d194edbba61909f12ff2834, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.588172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.647892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1210/2418] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:16 2022] PUT /identity/v3/projects/0c953a6495b04f09837d97f339848c7a/users/2a8929a38d194edbba61909f12ff2834/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:16.658124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f059f-e5ec-493d-93b2-2bfac0ae7d1c None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.658421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f059f-e5ec-493d-93b2-2bfac0ae7d1c None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.658703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f059f-e5ec-493d-93b2-2bfac0ae7d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.695927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3f2f059f-e5ec-493d-93b2-2bfac0ae7d1c None None] MFA Rules not processed for user `2a8929a38d194edbba61909f12ff2834`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:16.697600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3f2f059f-e5ec-493d-93b2-2bfac0ae7d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:16.764102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1209/2419] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:16.768714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.841346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4f96b-d687-450a-9fd2-90e0f6b94472 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.852147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:16.852820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:16.853098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:16.853427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:16.854136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:16.856839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:16.935531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1211/2420] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:16 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:16.939615 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f059f-e5ec-493d-93b2-2bfac0ae7d1c None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.957128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f059f-e5ec-493d-93b2-2bfac0ae7d1c None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:16.963436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:16.965301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:17.021323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.022964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.023562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.023846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.024578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.026194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759345e-65cf-49f1-8fb5-8bfecb5c0659 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:17.026508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:17.029992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.030724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.031078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.031452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.033354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:17.092149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.093575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:17.104194 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1212/2421] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:44:17.110192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1210/2422] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:16 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:17.113990 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:17.125022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6430b02-4d85-4b62-a680-6f2ac1ce21b8 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:17.130014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.130734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.131021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.132202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.135468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.135468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:17.138419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:17.140259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:17.153914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1213/2423] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:17.158730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5a46c-46b8-4832-a66d-74d63605967e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:17.160840 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:17.164559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.165454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.165740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.166018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] PATH_INFO: `/v3/users/842fa4b1c86e4c208ab1f1f119d3bdd8` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.167316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=842fa4b1c86e4c208ab1f1f119d3bdd8)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.169264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:17.177028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd03e25-fd37-4e2b-9a87-5171f49ceb24 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:17.182902 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.184071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.184452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.184833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] PATH_INFO: `/v3/projects/bbb8af56825148e2ab961e652f59513c/users/d19f5fa7ffb0421097a300af23968343/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.210619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb8af56825148e2ab961e652f59513c, user_id=d19f5fa7ffb0421097a300af23968343, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.213588 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:17.337913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1214/2424] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:17 2022] PUT /identity/v3/projects/bbb8af56825148e2ab961e652f59513c/users/d19f5fa7ffb0421097a300af23968343/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:17.341754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:17.372769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842fa4b1c86e4c208ab1f1f119d3bdd8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:17.379040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842fa4b1c86e4c208ab1f1f119d3bdd8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:17.407904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfa8d39-9a0f-4137-9324-e6def7fa45d3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:17.413977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.414860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.415200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.415487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.416228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.417833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:17.427980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1215/2425] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:44:17.432242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:17.442220 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bbb16a-48f3-4f49-95e4-e7cf11d4e0a3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:17.447625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3bf441-a657-47f0-996c-a7a18d0dd32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.448561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bf441-a657-47f0-996c-a7a18d0dd32f admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.448844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bf441-a657-47f0-996c-a7a18d0dd32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.449142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3bf441-a657-47f0-996c-a7a18d0dd32f admin admin] PATH_INFO: `/v3/projects/bbb8af56825148e2ab961e652f59513c/users/d19f5fa7ffb0421097a300af23968343/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.451813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bf441-a657-47f0-996c-a7a18d0dd32f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbb8af56825148e2ab961e652f59513c, user_id=d19f5fa7ffb0421097a300af23968343, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.454487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3bf441-a657-47f0-996c-a7a18d0dd32f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:17.463260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842fa4b1c86e4c208ab1f1f119d3bdd8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:17.465863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1216/2426] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:17 2022] PUT /identity/v3/projects/bbb8af56825148e2ab961e652f59513c/users/d19f5fa7ffb0421097a300af23968343/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:17.476868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842fa4b1c86e4c208ab1f1f119d3bdd8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:17.477592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee3e1d8d-6698-4e23-bc11-802c5b554e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842fa4b1c86e4c208ab1f1f119d3bdd8'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:17.483590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1211/2427] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:17 2022] DELETE /identity/v3/users/842fa4b1c86e4c208ab1f1f119d3bdd8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:17.485799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.486197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.486540 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.515435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] MFA Rules not processed for user `d19f5fa7ffb0421097a300af23968343`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:17.516650 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:17.589377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1217/2428] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:17.807903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.808217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.808520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.830232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] MFA Rules not processed for user `62bc5605a22d408f9b4bac69a0f5f486`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:17.830391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:17.831748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:17.835534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:17.902169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1212/2429] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:17.920438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3fcc7-957a-4665-8675-ced6b852426b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:17.925260 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:17.926119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:17.926408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:17.926685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] PATH_INFO: `/v3/projects/b51f628be6144a698276671df56eac18` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:17.927901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b51f628be6144a698276671df56eac18)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:17.930205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:18.013770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b51f628be6144a698276671df56eac18', 'request_id': 'req-68efb800-04b2-4c27-b8ed-6f9d2be93597'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:18.019945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b51f628be6144a698276671df56eac18', 'request_id': 'req-68efb800-04b2-4c27-b8ed-6f9d2be93597'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:18.027326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b51f628be6144a698276671df56eac18', 'request_id': 'req-68efb800-04b2-4c27-b8ed-6f9d2be93597'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:18.103054 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] The token cache is being invalidate because project b51f628be6144a698276671df56eac18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:18.103479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:18.104170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:18.105732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1218/2430] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:17 2022] DELETE /identity/v3/projects/b51f628be6144a698276671df56eac18 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:18.224431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:18.227093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:18.290162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c8457-955c-4d2f-aab9-e6cea64f4ac1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:18.338601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:18.339288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:18.339575 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:18.339856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:18.341632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:18.351891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:18.353321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:18.361545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1213/2431] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:18.769830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:18.771342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:18.848074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68efb800-04b2-4c27-b8ed-6f9d2be93597 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:18.853408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:18.854055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:18.854337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:18.854610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:18.856392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:18.868701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:18.870297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:18.879968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1219/2432] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:22.212036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:22.213616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:22.304203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4ab8f-a36e-4c59-b46c-a52b12f4f6e8 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:22.304203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:22.304203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:22.304203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:22.305640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:22.305640 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:22.361784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:22.363283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:22.373760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1214/2433] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:26.009067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:26.010571 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:26.071066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:26.072562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:26.076632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d899e-4629-45ec-be7e-0c760b8137da service placement] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:26.081338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:26.082205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:26.082490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:26.082770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] PATH_INFO: `/v3/users/ee453e2552684d4ba7501658b49654d2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:26.083359 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76c097-9a8d-4f19-815d-e31af947c4a3 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:26.084024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee453e2552684d4ba7501658b49654d2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:26.086835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:26.087721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1fd65-693e-4dac-8fbd-8b698b34130c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:26.088357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1fd65-693e-4dac-8fbd-8b698b34130c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:26.088634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1fd65-693e-4dac-8fbd-8b698b34130c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:26.088914 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1fd65-693e-4dac-8fbd-8b698b34130c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:26.090633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b2b1fd65-693e-4dac-8fbd-8b698b34130c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:26.155901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1fd65-693e-4dac-8fbd-8b698b34130c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:26.157336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1fd65-693e-4dac-8fbd-8b698b34130c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:26.167454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1215/2434] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:44:26.232745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee453e2552684d4ba7501658b49654d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:26.280135 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee453e2552684d4ba7501658b49654d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:26.292775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee453e2552684d4ba7501658b49654d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:26.293417 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee453e2552684d4ba7501658b49654d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:26.300569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee453e2552684d4ba7501658b49654d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:26.306690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1220/2435] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:26 2022] DELETE /identity/v3/users/ee453e2552684d4ba7501658b49654d2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:26.311593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:26.311883 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:26.312161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:26.331919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:26.333228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:26.395479 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1216/2436] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:26.405437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:26.406839 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:26.463050 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8000e-8267-443a-97e8-6d5d1d7e6cf8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:26.466844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:26.467651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:26.467925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:26.468205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:26.477690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:26.479207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:26.489243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1221/2437] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:26.876024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:26.879176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:26.891502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d248203-3842-4080-8cce-775d811ff3e6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:26.907082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:26.907082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:26.907082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:26.907082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] PATH_INFO: `/v3/projects/2c0bd824d8ab41ad82ae583e572f3c25` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:26.907679 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c0bd824d8ab41ad82ae583e572f3c25)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:26.909162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:27.075079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c0bd824d8ab41ad82ae583e572f3c25', 'request_id': 'req-e0669e8c-92d3-41ff-97cf-71e2b992bd86'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.137033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c0bd824d8ab41ad82ae583e572f3c25', 'request_id': 'req-e0669e8c-92d3-41ff-97cf-71e2b992bd86'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.143100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c0bd824d8ab41ad82ae583e572f3c25', 'request_id': 'req-e0669e8c-92d3-41ff-97cf-71e2b992bd86'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.155177 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] The token cache is being invalidate because project 2c0bd824d8ab41ad82ae583e572f3c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:27.155743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.156441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.158180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1217/2438] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:26 2022] DELETE /identity/v3/projects/2c0bd824d8ab41ad82ae583e572f3c25 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:27.162414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:27.172663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a3372-a69b-4bc6-b703-b1ba2536faa4 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:27.179527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:27.180933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:27.255530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:27.257217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:27.257579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:27.257930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] PATH_INFO: `/v3/users/d08e23341424448aaacd2b3210508915` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:27.259295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08e23341424448aaacd2b3210508915)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:27.261234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:27.265237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0669e8c-92d3-41ff-97cf-71e2b992bd86 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:27.271376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19f5fa7ffb0421097a300af23968343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbb8af56825148e2ab961e652f59513c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:27.272966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:27.273330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:27.273846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:27.275047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:27.275459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:27.277163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:27.294530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1218/2439] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:44:27.299191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:27.305722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb86c59-6fa9-4509-bd25-3e1c7afdcb21 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:27.310690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19f5fa7ffb0421097a300af23968343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbb8af56825148e2ab961e652f59513c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:27.311371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:27.311663 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:27.311971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:27.312849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:27.314801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:27.431264 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1219/2440] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:27 2022] POST /identity/v3/projects => generated 354 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:27.435295 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:27.453143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08e23341424448aaacd2b3210508915'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.496402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df629833-a943-4d6c-8874-080e9da33008 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:27.501083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19f5fa7ffb0421097a300af23968343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbb8af56825148e2ab961e652f59513c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:27.501738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:27.502024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:27.502302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:27.503023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:27.503366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:27.506125 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:27.516209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1220/2441] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:44:27.525810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08e23341424448aaacd2b3210508915'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.541561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08e23341424448aaacd2b3210508915'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.542399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08e23341424448aaacd2b3210508915'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.549630 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08e23341424448aaacd2b3210508915'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.557245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1222/2442] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:27 2022] DELETE /identity/v3/users/d08e23341424448aaacd2b3210508915 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:27.558841 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:27.561349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:27.574202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7ef3c9-9314-4ec2-b968-986aaf096d9e tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:27.634403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd19f5fa7ffb0421097a300af23968343', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbb8af56825148e2ab961e652f59513c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:27.635301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:27.635611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:27.635890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] PATH_INFO: `/v3/projects/293725406cab4af9af75e371e8d690b0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:27.637078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=293725406cab4af9af75e371e8d690b0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:27.639072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:27.761163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293725406cab4af9af75e371e8d690b0', 'request_id': 'req-c685d310-bb1c-4dff-ad69-2d101052d5b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.834972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293725406cab4af9af75e371e8d690b0', 'request_id': 'req-c685d310-bb1c-4dff-ad69-2d101052d5b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.841085 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293725406cab4af9af75e371e8d690b0', 'request_id': 'req-c685d310-bb1c-4dff-ad69-2d101052d5b6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.855035 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] The token cache is being invalidate because project 293725406cab4af9af75e371e8d690b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:27.855354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.856105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:27.857747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1221/2443] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:27 2022] DELETE /identity/v3/projects/293725406cab4af9af75e371e8d690b0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:27.938734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:27.940423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:28.015723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf109-0d78-49b9-b503-0bcbfb3d8c1a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:28.069382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:28.070727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:28.071013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:28.071316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] PATH_INFO: `/v3/projects/c033d11f274745548798b78c9da45d25` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:28.072524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c033d11f274745548798b78c9da45d25)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:28.074591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:28.229428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c033d11f274745548798b78c9da45d25', 'request_id': 'req-d7167b34-eda2-4b38-9a0a-928a7641ee61'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.237781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c033d11f274745548798b78c9da45d25', 'request_id': 'req-d7167b34-eda2-4b38-9a0a-928a7641ee61'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.249342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c033d11f274745548798b78c9da45d25', 'request_id': 'req-d7167b34-eda2-4b38-9a0a-928a7641ee61'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.314014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] The token cache is being invalidate because project c033d11f274745548798b78c9da45d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:28.314310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.315577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.317214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1223/2444] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:27 2022] DELETE /identity/v3/projects/c033d11f274745548798b78c9da45d25 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:28.321196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:28.322737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:28.335877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d310-bb1c-4dff-ad69-2d101052d5b6 tempest-VolumeQuotaClassesTest-999804424 tempest-VolumeQuotaClassesTest-999804424-project-admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:28.391654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:28.393069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:28.394898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:28.395812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:28.396101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:28.396381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] PATH_INFO: `/v3/users/2d832c2477cd4df18b483f5be7979c02` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:28.397738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d832c2477cd4df18b483f5be7979c02)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:28.399716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:28.406075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7167b34-eda2-4b38-9a0a-928a7641ee61 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:28.410673 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:28.411569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:28.411853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:28.412152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] PATH_INFO: `/v3/users/2a8929a38d194edbba61909f12ff2834` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:28.414352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a8929a38d194edbba61909f12ff2834)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:28.416306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:28.545036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d832c2477cd4df18b483f5be7979c02'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.551991 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d832c2477cd4df18b483f5be7979c02'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.591019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a8929a38d194edbba61909f12ff2834'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.628832 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d832c2477cd4df18b483f5be7979c02'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.640970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d832c2477cd4df18b483f5be7979c02'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.642030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ff448c81-d91b-4423-b2d8-88007449af21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d832c2477cd4df18b483f5be7979c02'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.648255 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1222/2445] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:28 2022] DELETE /identity/v3/users/2d832c2477cd4df18b483f5be7979c02 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:28.703226 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a8929a38d194edbba61909f12ff2834'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.719460 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a8929a38d194edbba61909f12ff2834'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.720604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a8929a38d194edbba61909f12ff2834'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.728865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a8929a38d194edbba61909f12ff2834'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:28.735862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1224/2446] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:28 2022] DELETE /identity/v3/users/2a8929a38d194edbba61909f12ff2834 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:28.742430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:28.745454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:28.745454 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:28.762926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:28.764167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:28.824163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1223/2447] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:28.835718 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:28.837847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:28.914506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:28.916033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:28.918289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9fbd7f-c78e-40f3-acd5-46c0775b12a7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:28.923792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:28.924771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:28.925149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:28.925430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:28.936234 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:28.937733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:28.952592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1225/2448] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:28.999596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7252d6-28ca-4390-a38d-187118113b3b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.007536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04431ee-5f09-4b47-9a23-71729c385824 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.008199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04431ee-5f09-4b47-9a23-71729c385824 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.008477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04431ee-5f09-4b47-9a23-71729c385824 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.008871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04431ee-5f09-4b47-9a23-71729c385824 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.013899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e04431ee-5f09-4b47-9a23-71729c385824 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:29.032531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04431ee-5f09-4b47-9a23-71729c385824 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.034420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04431ee-5f09-4b47-9a23-71729c385824 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.046259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1224/2449] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:29.084541 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.086013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:29.099332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dcc439-1d7c-4c54-872f-da33b7c5d6b3 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.105603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.107639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.117490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.117490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] PATH_INFO: `/v3/projects/8c0088f85e1f49fa81b6f7b4ca2da13a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.117490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0088f85e1f49fa81b6f7b4ca2da13a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.117490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.244731 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0088f85e1f49fa81b6f7b4ca2da13a', 'request_id': 'req-38e204cf-eaa7-480f-a823-313d35a58e08'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.250370 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0088f85e1f49fa81b6f7b4ca2da13a', 'request_id': 'req-38e204cf-eaa7-480f-a823-313d35a58e08'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.257272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0088f85e1f49fa81b6f7b4ca2da13a', 'request_id': 'req-38e204cf-eaa7-480f-a823-313d35a58e08'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.341915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] The token cache is being invalidate because project 8c0088f85e1f49fa81b6f7b4ca2da13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:29.341915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.341915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38e204cf-eaa7-480f-a823-313d35a58e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.341915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1226/2450] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:29 2022] DELETE /identity/v3/projects/8c0088f85e1f49fa81b6f7b4ca2da13a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:29.346807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8adb8-5938-4b14-b78e-62ac4ebb25eb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.347337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8adb8-5938-4b14-b78e-62ac4ebb25eb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.347432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8adb8-5938-4b14-b78e-62ac4ebb25eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.369334 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-86a8adb8-5938-4b14-b78e-62ac4ebb25eb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:29.370567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-86a8adb8-5938-4b14-b78e-62ac4ebb25eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:29.430657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1225/2451] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:29.438987 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.439313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.439596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.457580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:29.458820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:29.467284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1227/2452] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:29.480381 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8adb8-5938-4b14-b78e-62ac4ebb25eb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.490026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8adb8-5938-4b14-b78e-62ac4ebb25eb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.495012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.495698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.495986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.496263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.496992 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:29.497302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.498900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.510421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.510979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1226/2453] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:44:29.514859 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.515091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:29.531368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d415cc-1e23-4d29-916a-7dde85548dd1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.532227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876130ae-388e-4a5c-89b3-0007b285af82 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.536268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.536938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.537222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.538233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.538884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.540915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.544941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.546250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.546250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.546549 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] PATH_INFO: `/v3/projects/0c953a6495b04f09837d97f339848c7a` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.547557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c953a6495b04f09837d97f339848c7a)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.549479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.630807 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1227/2454] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:29 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:29.635895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.663589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c953a6495b04f09837d97f339848c7a', 'request_id': 'req-743ba8bd-a893-4695-ba1e-3d257b08ab58'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.670438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c953a6495b04f09837d97f339848c7a', 'request_id': 'req-743ba8bd-a893-4695-ba1e-3d257b08ab58'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.676811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c953a6495b04f09837d97f339848c7a', 'request_id': 'req-743ba8bd-a893-4695-ba1e-3d257b08ab58'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.699886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1673-f554-40ea-986b-42620c3b741c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.756290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.757020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.757304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.757583 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.758344 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.760320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.822531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] The token cache is being invalidate because project 0c953a6495b04f09837d97f339848c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:29.822827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.823492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:29.825097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1228/2455] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:29 2022] DELETE /identity/v3/projects/0c953a6495b04f09837d97f339848c7a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:29.828936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.830233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:29.842843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ba8bd-a893-4695-ba1e-3d257b08ab58 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.848111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.848985 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.849270 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.849598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] PATH_INFO: `/v3/users/d19f5fa7ffb0421097a300af23968343` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.851408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d19f5fa7ffb0421097a300af23968343)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.853348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.892115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1228/2456] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:29 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:29.896015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.897775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:29.909114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19447b-7747-491e-8f90-d147a8662395 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.914873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.915564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.915848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.916123 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.916849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.918464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.929024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1229/2457] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:44:29.933069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.942445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfece9dd-10c6-4fb2-bc20-085ac1eed2f6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.947439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.948083 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.948365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.948650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.949367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:29.950959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:29.961940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1230/2458] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:44:29.966316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:29.976449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2618a75-de92-407c-aa34-acf227c5781c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:29.981045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae91826-1175-4323-a048-986b884f9c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:29.981886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae91826-1175-4323-a048-986b884f9c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:29.982170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae91826-1175-4323-a048-986b884f9c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:29.982446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae91826-1175-4323-a048-986b884f9c87 admin admin] PATH_INFO: `/v3/projects/11f73ab5e1164c008341438ea9fb1f3c/users/0b792facf14144f28d33a2e1dfecb3de/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:29.997799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae91826-1175-4323-a048-986b884f9c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f73ab5e1164c008341438ea9fb1f3c, user_id=0b792facf14144f28d33a2e1dfecb3de, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:30.000483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae91826-1175-4323-a048-986b884f9c87 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:30.019030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd19f5fa7ffb0421097a300af23968343'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.058590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1231/2459] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:29 2022] PUT /identity/v3/projects/11f73ab5e1164c008341438ea9fb1f3c/users/0b792facf14144f28d33a2e1dfecb3de/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:30.068784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd19f5fa7ffb0421097a300af23968343'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.070579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.070873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.071207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.081787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd19f5fa7ffb0421097a300af23968343'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.082488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd19f5fa7ffb0421097a300af23968343'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.089675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd19f5fa7ffb0421097a300af23968343'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.095837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1229/2460] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:29 2022] DELETE /identity/v3/users/d19f5fa7ffb0421097a300af23968343 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:30.097350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] MFA Rules not processed for user `0b792facf14144f28d33a2e1dfecb3de`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:30.098546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.163287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1232/2461] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:30.175258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:30.176654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.233641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cb266-4a40-4c84-b944-1a56fdfd7286 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:30.237230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:30.237867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.238149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.238490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.247498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:30.248910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:30.259689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1230/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:30.278622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:30.280059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.354466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c82eba-12c4-4f32-94a6-ad774c998fa5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:30.360452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:30.361155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.361440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.361721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] PATH_INFO: `/v3/users/0b792facf14144f28d33a2e1dfecb3de` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.363483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b792facf14144f28d33a2e1dfecb3de)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:30.365948 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:30.491584 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:30.493605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.523034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba752aa-0807-4543-a7f2-213466629f7d service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:30.527795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b792facf14144f28d33a2e1dfecb3de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.536153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b792facf14144f28d33a2e1dfecb3de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.540747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:30.541720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.542007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.542285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] PATH_INFO: `/v3/projects/bbb8af56825148e2ab961e652f59513c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.544384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbb8af56825148e2ab961e652f59513c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:30.546565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:30.611607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b792facf14144f28d33a2e1dfecb3de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.624111 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b792facf14144f28d33a2e1dfecb3de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.624772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fec36aa3-601c-4703-98e0-74000e977ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b792facf14144f28d33a2e1dfecb3de'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.630744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1233/2463] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:30 2022] DELETE /identity/v3/users/0b792facf14144f28d33a2e1dfecb3de => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:30.635819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.636127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.636406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.654407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:30.655634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.675489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbb8af56825148e2ab961e652f59513c', 'request_id': 'req-76ae9957-60e5-4271-a086-461f598b4f2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.681921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbb8af56825148e2ab961e652f59513c', 'request_id': 'req-76ae9957-60e5-4271-a086-461f598b4f2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.691077 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbb8af56825148e2ab961e652f59513c', 'request_id': 'req-76ae9957-60e5-4271-a086-461f598b4f2b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.719430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1234/2464] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:30.729375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:30.730898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.743600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] The token cache is being invalidate because project bbb8af56825148e2ab961e652f59513c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:30.743948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.744605 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-76ae9957-60e5-4271-a086-461f598b4f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:30.746827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1231/2465] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:30 2022] DELETE /identity/v3/projects/bbb8af56825148e2ab961e652f59513c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:30.761517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48f0d1-df02-4ba2-9172-951b3b1285a7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.761808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48f0d1-df02-4ba2-9172-951b3b1285a7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.762097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48f0d1-df02-4ba2-9172-951b3b1285a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.781396 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-4d48f0d1-df02-4ba2-9172-951b3b1285a7 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:30.782603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-4d48f0d1-df02-4ba2-9172-951b3b1285a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.795958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e60a6-f7f6-4d2f-a198-7797e216c06d None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:30.842407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1232/2466] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:30.848581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:30.849459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.850339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.850781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.851451 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8552136-d042-4102-8527-6420e3c26306 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.851713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8552136-d042-4102-8527-6420e3c26306 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.851993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8552136-d042-4102-8527-6420e3c26306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.853077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.865148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:30.867772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:30.870722 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-d8552136-d042-4102-8527-6420e3c26306 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:30.871941 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d8552136-d042-4102-8527-6420e3c26306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:30.877730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1235/2467] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:44:30.880171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1233/2468] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:30.884629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:30.893568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c9624-c254-417e-aa7f-122f8d58ce33 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:30.899655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:30.900314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.900597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.900877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.901605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:30.901911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:30.903775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:30.919358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1236/2469] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:44:30.925960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8552136-d042-4102-8527-6420e3c26306 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:30.930480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8552136-d042-4102-8527-6420e3c26306 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:30.935244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:30.935904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:30.936311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:30.936599 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:30.937362 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:30.939295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.053228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1234/2470] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:30 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:31.057498 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.067207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359e9d5-53ab-4680-b3a5-3de155c1269e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.132935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.133614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.133901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.134188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.134890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.136929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.234532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1237/2471] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:31.238624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.249569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e886429-e613-46ff-9f8c-7d6e752cfad6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.254248 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.254901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.255211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.255488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.256249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.257838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.268020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1235/2472] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:31.272107 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.282241 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ec967-5ee3-456c-936b-cb5db5cd4e1b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.286926 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.288682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.288965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.289246 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.289973 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.291651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.301390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1238/2473] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:31.306016 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.316147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.318104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:31.319320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405dc10-d42a-4dfc-a231-918be0519235 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.325392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e318188-5531-4fe6-9fd5-f86eaa867a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.326355 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318188-5531-4fe6-9fd5-f86eaa867a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.326553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318188-5531-4fe6-9fd5-f86eaa867a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.326856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e318188-5531-4fe6-9fd5-f86eaa867a20 admin admin] PATH_INFO: `/v3/projects/b6c5ea1b31744d2aac839f8cd5c79261/users/c2a6c2f795114ab2899fe791d3340c8f/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.341121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10fe4ef-c619-461b-b75e-76093766ba60 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.343645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e318188-5531-4fe6-9fd5-f86eaa867a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c5ea1b31744d2aac839f8cd5c79261, user_id=c2a6c2f795114ab2899fe791d3340c8f, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.346720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e318188-5531-4fe6-9fd5-f86eaa867a20 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.347716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.348763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.349139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.349506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] PATH_INFO: `/v3/projects/11f73ab5e1164c008341438ea9fb1f3c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.351167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f73ab5e1164c008341438ea9fb1f3c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.353272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.434827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1236/2474] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:31 2022] PUT /identity/v3/projects/b6c5ea1b31744d2aac839f8cd5c79261/users/c2a6c2f795114ab2899fe791d3340c8f/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:31.447101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f45c6-4a42-43b3-81ae-c87e05827c68 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.447419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f45c6-4a42-43b3-81ae-c87e05827c68 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.447696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f45c6-4a42-43b3-81ae-c87e05827c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.475933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f73ab5e1164c008341438ea9fb1f3c', 'request_id': 'req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:31.478264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a61f45c6-4a42-43b3-81ae-c87e05827c68 None None] MFA Rules not processed for user `c2a6c2f795114ab2899fe791d3340c8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:31.478264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a61f45c6-4a42-43b3-81ae-c87e05827c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:31.539611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1237/2475] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:31.544121 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f45c6-4a42-43b3-81ae-c87e05827c68 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.554283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f73ab5e1164c008341438ea9fb1f3c', 'request_id': 'req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:31.560170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f73ab5e1164c008341438ea9fb1f3c', 'request_id': 'req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:31.572183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] The token cache is being invalidate because project 11f73ab5e1164c008341438ea9fb1f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:31.572468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:31.573195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1fdecb7a-5618-41b4-ac41-12c5c4ccd4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:31.574721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1239/2476] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:31 2022] DELETE /identity/v3/projects/11f73ab5e1164c008341438ea9fb1f3c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:31.579736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873c39c-91f7-409b-991a-c61ba9c23912 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.580016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873c39c-91f7-409b-991a-c61ba9c23912 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.580288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873c39c-91f7-409b-991a-c61ba9c23912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.602285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5873c39c-91f7-409b-991a-c61ba9c23912 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:31.602285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5873c39c-91f7-409b-991a-c61ba9c23912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:31.606924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f45c6-4a42-43b3-81ae-c87e05827c68 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.611305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1240/2477] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:31.612292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.613085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.613436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.613560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.614247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.616867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.673505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f0e6-c74c-4b49-95c0-d49ac560a505 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.673902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f0e6-c74c-4b49-95c0-d49ac560a505 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.674249 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f0e6-c74c-4b49-95c0-d49ac560a505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.693100 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f514f0e6-c74c-4b49-95c0-d49ac560a505 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:31.695312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f514f0e6-c74c-4b49-95c0-d49ac560a505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:31.703496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1241/2478] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:31.707490 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f0e6-c74c-4b49-95c0-d49ac560a505 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.716981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1238/2479] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:31.719811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f0e6-c74c-4b49-95c0-d49ac560a505 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.721498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.723148 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:31.786551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.787288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.787620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.788015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.788799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:31.789245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.790894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.791739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586cb2d-cb44-48ca-9922-8689ec3406d5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.797006 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.797679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.797973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.798228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.798983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.800940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.804893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1242/2480] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:44:31.809427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.820341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96117e0c-ae36-4379-a5e7-b7541b98b69f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.825047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.825701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.825985 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.828114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.828114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.828902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.886744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1239/2481] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:31.886744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.894935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd74c1-e740-4aac-a096-3dac1953b294 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.899668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.900330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.900620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.900889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.901615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.903263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.909694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1243/2482] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:31.912560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.917553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1240/2483] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:44:31.918652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:31.929506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5780d-8a43-4992-85db-6310b97da488 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.979052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3485-0293-4415-be45-08f4f3444d3d admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:31.983972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.984703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.985060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.985461 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:31.986219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:31.988271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:31.990977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:31.992063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:31.992425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:31.992887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] PATH_INFO: `/v3/projects/040d69fc719d4a1d827b0d1d8af55a84/users/081e5e699e774f7197bc153c2822218d/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.008253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040d69fc719d4a1d827b0d1d8af55a84, user_id=081e5e699e774f7197bc153c2822218d, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.011138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.063626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1244/2484] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:31 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:32.067752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:32.078418 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352012d-c438-4cea-a36e-c5d1fb86b93f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:32.083443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:32.084155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.084482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.084747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.085494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.087336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.098092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1241/2485] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:31 2022] PUT /identity/v3/projects/040d69fc719d4a1d827b0d1d8af55a84/users/081e5e699e774f7197bc153c2822218d/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:32.102493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1245/2486] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:44:32.102691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:32.103854 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:32.114463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570af19-7a5e-49de-9dad-790d33baff01 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:32.170316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663cb9ce-4e91-494b-9233-ac393d84e4c8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:32.179399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:32.180008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:32.180170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.180408 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.180629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.180752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.180983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.181265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.181399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.182009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.182974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.183672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.195170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1246/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:32.195502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1242/2488] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:32.201918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:32.202123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:32.218363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d9a76-58ee-469b-befc-b4602c2d5a08 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:32.220300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626d575-db97-478a-8c05-6c78892c9078 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:32.223637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42bce-ece4-416a-9f9f-49b5218b7606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:32.224540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42bce-ece4-416a-9f9f-49b5218b7606 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.224866 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42bce-ece4-416a-9f9f-49b5218b7606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.225146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42bce-ece4-416a-9f9f-49b5218b7606 admin admin] PATH_INFO: `/v3/projects/040d69fc719d4a1d827b0d1d8af55a84/users/081e5e699e774f7197bc153c2822218d/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.226183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216201b9-cfff-4f2c-a9a9-0a32d9748095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:32.227291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216201b9-cfff-4f2c-a9a9-0a32d9748095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.227450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b42bce-ece4-416a-9f9f-49b5218b7606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=040d69fc719d4a1d827b0d1d8af55a84, user_id=081e5e699e774f7197bc153c2822218d, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.227752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216201b9-cfff-4f2c-a9a9-0a32d9748095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.228117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216201b9-cfff-4f2c-a9a9-0a32d9748095 admin admin] PATH_INFO: `/v3/projects/ee4603ab074f4758ac49d42c5d44545b/users/030818ed3ef046beabd1188e377dea7b/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.230082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b42bce-ece4-416a-9f9f-49b5218b7606 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.242020 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1247/2489] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:32 2022] PUT /identity/v3/projects/040d69fc719d4a1d827b0d1d8af55a84/users/081e5e699e774f7197bc153c2822218d/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:32.246295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216201b9-cfff-4f2c-a9a9-0a32d9748095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4603ab074f4758ac49d42c5d44545b, user_id=030818ed3ef046beabd1188e377dea7b, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.250376 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216201b9-cfff-4f2c-a9a9-0a32d9748095 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.253017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.253309 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.253587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.281778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] MFA Rules not processed for user `081e5e699e774f7197bc153c2822218d`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:32.283010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:32.326824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1243/2490] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:32 2022] PUT /identity/v3/projects/ee4603ab074f4758ac49d42c5d44545b/users/030818ed3ef046beabd1188e377dea7b/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:32.337936 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.338296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.338643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.354844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1248/2491] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:32.367636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:32.369214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:32.370108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] MFA Rules not processed for user `030818ed3ef046beabd1188e377dea7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:32.371478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:32.439964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1244/2492] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:32.453760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972ba6f-20e2-45c3-91e7-b4aa0c97ed90 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:32.472018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:32.475772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:32.505658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392ac62-eb8b-4791-b21e-a07e3fda1b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:32.506509 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ac62-eb8b-4791-b21e-a07e3fda1b5a service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.506783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ac62-eb8b-4791-b21e-a07e3fda1b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.507059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392ac62-eb8b-4791-b21e-a07e3fda1b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.535182 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeca858-5e50-4ac6-909b-425f97c40de7 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:32.539834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:32.540488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:32.540769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:32.541332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:32.551276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.553714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.563189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1245/2493] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:32.573425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392ac62-eb8b-4791-b21e-a07e3fda1b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:32.577523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392ac62-eb8b-4791-b21e-a07e3fda1b5a service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:32.586004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1249/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:33.149445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:33.245379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb64fb13-dff5-461a-a48d-bf2fc83785b0 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:33.250846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:33.253254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:33.253986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:33.254510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] PATH_INFO: `/v3/users/c2a6c2f795114ab2899fe791d3340c8f` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:33.267654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2a6c2f795114ab2899fe791d3340c8f)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:33.270487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:33.405363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2a6c2f795114ab2899fe791d3340c8f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:33.457762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2a6c2f795114ab2899fe791d3340c8f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:33.472861 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2a6c2f795114ab2899fe791d3340c8f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:33.473616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2a6c2f795114ab2899fe791d3340c8f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:33.481634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2a6c2f795114ab2899fe791d3340c8f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:33.488536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1246/2495] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:33 2022] DELETE /identity/v3/users/c2a6c2f795114ab2899fe791d3340c8f => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:33.493403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:33.493943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:33.494406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:33.512806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:33.514673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:33.587790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1250/2496] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:33.597856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:33.600746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:33.669373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd119062-d598-4e7b-8259-24e328db74e0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:33.673505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:33.674076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:33.674360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:33.674642 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:33.684794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:33.686352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:33.696981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1247/2497] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:44:34.088196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:34.089931 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:34.103093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268e314-5fbf-4ab2-8784-4651792018bb None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:34.107916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:34.108974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:34.109265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:34.109547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] PATH_INFO: `/v3/projects/b6c5ea1b31744d2aac839f8cd5c79261` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:34.110763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c5ea1b31744d2aac839f8cd5c79261)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:34.112749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:34.241247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c5ea1b31744d2aac839f8cd5c79261', 'request_id': 'req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.337436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c5ea1b31744d2aac839f8cd5c79261', 'request_id': 'req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.349235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c5ea1b31744d2aac839f8cd5c79261', 'request_id': 'req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.357778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] The token cache is being invalidate because project b6c5ea1b31744d2aac839f8cd5c79261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:34.358074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.358738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.360355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1251/2498] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:34 2022] DELETE /identity/v3/projects/b6c5ea1b31744d2aac839f8cd5c79261 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:34.364402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:34.374745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f9054-864e-4fbb-b6e7-4282039b1cf2 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:34.434034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:34.434853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:34.435146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:34.435489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] PATH_INFO: `/v3/users/081e5e699e774f7197bc153c2822218d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:34.436695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081e5e699e774f7197bc153c2822218d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:34.438659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:34.614762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081e5e699e774f7197bc153c2822218d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.668980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081e5e699e774f7197bc153c2822218d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.681674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081e5e699e774f7197bc153c2822218d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.682302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081e5e699e774f7197bc153c2822218d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.689093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-38cd0bc3-ab32-4d0b-94b0-ae906694ba97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081e5e699e774f7197bc153c2822218d'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:34.695168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1248/2499] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:34 2022] DELETE /identity/v3/users/081e5e699e774f7197bc153c2822218d => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:35.121552 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:35.123007 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:35.139299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc11fb-3942-4c68-ac9d-ed1e6bf757f1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:35.196717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:35.197493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.197773 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.198049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] PATH_INFO: `/v3/projects/040d69fc719d4a1d827b0d1d8af55a84` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.199287 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=040d69fc719d4a1d827b0d1d8af55a84)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:35.201194 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:35.332374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '040d69fc719d4a1d827b0d1d8af55a84', 'request_id': 'req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:35.394550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '040d69fc719d4a1d827b0d1d8af55a84', 'request_id': 'req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:35.400867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '040d69fc719d4a1d827b0d1d8af55a84', 'request_id': 'req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:35.411732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] The token cache is being invalidate because project 040d69fc719d4a1d827b0d1d8af55a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:35.412022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:35.412811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-430a0ffa-618c-4b35-9b1d-e2f8ce4d9330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:35.414343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1252/2500] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:35 2022] DELETE /identity/v3/projects/040d69fc719d4a1d827b0d1d8af55a84 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:35.419192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8b715-7b09-47a4-bda1-b4ceac4af6e5 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.419660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8b715-7b09-47a4-bda1-b4ceac4af6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.419781 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab8b715-7b09-47a4-bda1-b4ceac4af6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.437623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-2ab8b715-7b09-47a4-bda1-b4ceac4af6e5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:35.438811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2ab8b715-7b09-47a4-bda1-b4ceac4af6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:35.497661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1249/2501] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:35.505276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311f1e-c643-49c6-b75d-1505e5cf7bc6 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.505567 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311f1e-c643-49c6-b75d-1505e5cf7bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.505866 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82311f1e-c643-49c6-b75d-1505e5cf7bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.525584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-82311f1e-c643-49c6-b75d-1505e5cf7bc6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:35.526765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-82311f1e-c643-49c6-b75d-1505e5cf7bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:35.534425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1253/2502] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:44:35.538911 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8b715-7b09-47a4-bda1-b4ceac4af6e5 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:35.548404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab8b715-7b09-47a4-bda1-b4ceac4af6e5 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:35.553573 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:35.554223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.554510 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.554793 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.555634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:35.555950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:35.557547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:35.568996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1250/2503] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:44:35.572982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311f1e-c643-49c6-b75d-1505e5cf7bc6 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:35.581837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82311f1e-c643-49c6-b75d-1505e5cf7bc6 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:35.587616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:35.588526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.588943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.589355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.590126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:35.592043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:35.710717 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1254/2504] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:35 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:35.714746 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:35.725745 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1906-8127-469e-850e-c099531a626b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:35.782328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:35.782914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.783228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.783533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.784239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:35.786162 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:35.897851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1251/2505] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:35 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:35.901836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:35.911987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac516d-aa48-49be-a1c7-f2fef83178a9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:35.916979 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:35.917639 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.917918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.918196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.918949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:35.920584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:35.930830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1255/2506] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:35.934648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:35.945124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a87a-4af4-4e76-b232-df1745d3c010 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:35.950099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90940b6-5d9e-45f6-b704-9ee73ac736c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:35.950747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90940b6-5d9e-45f6-b704-9ee73ac736c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.951034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90940b6-5d9e-45f6-b704-9ee73ac736c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.951344 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90940b6-5d9e-45f6-b704-9ee73ac736c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.952081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90940b6-5d9e-45f6-b704-9ee73ac736c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:35.953687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90940b6-5d9e-45f6-b704-9ee73ac736c5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:35.964516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1252/2507] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:35.968500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:35.978692 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c9b2-377d-48a1-919b-85b5cf8854a3 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:35.983286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:35.984153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:35.984435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:35.984711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] PATH_INFO: `/v3/projects/2a8cedfe8cfe47378bb309b17bb08851/users/e00cdade114e466e9830d405b7cc4055/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:35.998832 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8cedfe8cfe47378bb309b17bb08851, user_id=e00cdade114e466e9830d405b7cc4055, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:36.001491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:36.103694 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1256/2508] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:35 2022] PUT /identity/v3/projects/2a8cedfe8cfe47378bb309b17bb08851/users/e00cdade114e466e9830d405b7cc4055/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:36.114560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a8e4-5612-4f6d-8610-dfe97b27c585 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:36.114962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a8e4-5612-4f6d-8610-dfe97b27c585 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:36.115243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985a8e4-5612-4f6d-8610-dfe97b27c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:36.142622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-b985a8e4-5612-4f6d-8610-dfe97b27c585 None None] MFA Rules not processed for user `e00cdade114e466e9830d405b7cc4055`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:36.143854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b985a8e4-5612-4f6d-8610-dfe97b27c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:36.214904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1253/2509] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:36.227634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:36.229350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:36.288313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e85c5-e2eb-4292-915d-5cc13e88ed04 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:36.292039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6dcf0c-bfde-4690-918d-ac31334270c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:36.292723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dcf0c-bfde-4690-918d-ac31334270c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:36.293022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dcf0c-bfde-4690-918d-ac31334270c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:36.293293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6dcf0c-bfde-4690-918d-ac31334270c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:36.302095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dcf0c-bfde-4690-918d-ac31334270c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:36.304069 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6dcf0c-bfde-4690-918d-ac31334270c7 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:36.314437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1257/2510] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:36.334727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a8e4-5612-4f6d-8610-dfe97b27c585 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:36.397480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985a8e4-5612-4f6d-8610-dfe97b27c585 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:36.402245 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:36.403190 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:36.403434 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:36.403735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] PATH_INFO: `/v3/users/e00cdade114e466e9830d405b7cc4055` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:36.404961 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00cdade114e466e9830d405b7cc4055)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:36.406930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:36.562593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00cdade114e466e9830d405b7cc4055'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:36.605703 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00cdade114e466e9830d405b7cc4055'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:36.618652 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00cdade114e466e9830d405b7cc4055'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:36.619427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00cdade114e466e9830d405b7cc4055'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:36.626095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00cdade114e466e9830d405b7cc4055'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:36.632929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1254/2511] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:44:36 2022] DELETE /identity/v3/users/e00cdade114e466e9830d405b7cc4055 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:36.637764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:36.638050 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:36.638424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:36.657956 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:36.659034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:36.730613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1258/2512] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:36.741288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:36.742806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:36.801818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eca8f3-2448-432c-bc8c-bc88ecde1e2d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:36.805546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7fe1b-a5c1-4c1b-a5bd-55844fe3ad55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:36.806324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7fe1b-a5c1-4c1b-a5bd-55844fe3ad55 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:36.806654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7fe1b-a5c1-4c1b-a5bd-55844fe3ad55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:36.806965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7fe1b-a5c1-4c1b-a5bd-55844fe3ad55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:36.816678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7fe1b-a5c1-4c1b-a5bd-55844fe3ad55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:36.818145 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7fe1b-a5c1-4c1b-a5bd-55844fe3ad55 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:36.828894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1255/2513] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:44:37.242160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:37.247270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:37.257518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687228d9-36ac-409e-938e-1f987593ad48 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:37.262355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:37.263306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.263587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.263925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] PATH_INFO: `/v3/projects/2a8cedfe8cfe47378bb309b17bb08851` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.265449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8cedfe8cfe47378bb309b17bb08851)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:37.268221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:37.372259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8cedfe8cfe47378bb309b17bb08851', 'request_id': 'req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:37.445761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8cedfe8cfe47378bb309b17bb08851', 'request_id': 'req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:37.451748 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8cedfe8cfe47378bb309b17bb08851', 'request_id': 'req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:37.462486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] The token cache is being invalidate because project 2a8cedfe8cfe47378bb309b17bb08851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:44:37.462775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:37.463425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d6336a-7f16-45ed-a0fb-2ca2489aa6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:44:37.464989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1259/2514] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:44:37 2022] DELETE /identity/v3/projects/2a8cedfe8cfe47378bb309b17bb08851 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:44:37.470010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6bd4-ba78-4403-9fc0-0ecd3b2e0a2d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.470342 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6bd4-ba78-4403-9fc0-0ecd3b2e0a2d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.471498 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e6bd4-ba78-4403-9fc0-0ecd3b2e0a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.488817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-153e6bd4-ba78-4403-9fc0-0ecd3b2e0a2d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:37.489942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-153e6bd4-ba78-4403-9fc0-0ecd3b2e0a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:37.547496 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1256/2515] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:37.556608 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b520b-1aa2-4d96-a5a5-12adf1bf4425 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.556896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b520b-1aa2-4d96-a5a5-12adf1bf4425 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.557243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b520b-1aa2-4d96-a5a5-12adf1bf4425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.576268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-da4b520b-1aa2-4d96-a5a5-12adf1bf4425 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:37.577467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-da4b520b-1aa2-4d96-a5a5-12adf1bf4425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:37.586121 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1260/2516] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:37.590444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e6bd4-ba78-4403-9fc0-0ecd3b2e0a2d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:37.600526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e6bd4-ba78-4403-9fc0-0ecd3b2e0a2d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:37.605867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:37.606554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.607009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.607365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.608140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:44:37.608478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:37.610075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:37.622468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1257/2517] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:44:37.627401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b520b-1aa2-4d96-a5a5-12adf1bf4425 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:37.637728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b520b-1aa2-4d96-a5a5-12adf1bf4425 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:37.642332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:37.642981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.643300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.643579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.644304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:37.646268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:37.751153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1261/2518] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:44:37 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:44:37.755206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:37.765920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de9f45-b163-48ce-945c-d3ca43a845c0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:37.826925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:37.827669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.827957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.828235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.828940 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:37.830969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:37.879586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1258/2519] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:44:37 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:44:37.884335 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:37.894627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89fcc6-8def-4f8c-a1c3-2d2cff2b4431 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:37.899304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:37.899958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.900271 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.900549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.901275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:37.902866 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:37.913063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1262/2520] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:37.917174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:37.926767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465517f-c714-439a-b1f9-02428ff2944f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:37.932059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4c167-4feb-4bcd-a63e-5c764928015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:37.932709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c167-4feb-4bcd-a63e-5c764928015f admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.932989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c167-4feb-4bcd-a63e-5c764928015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.933262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4c167-4feb-4bcd-a63e-5c764928015f admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.933984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4c167-4feb-4bcd-a63e-5c764928015f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:37.935592 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4c167-4feb-4bcd-a63e-5c764928015f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:37.945961 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1259/2521] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:44:37.949905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:37.959631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332a28b-a020-494c-bee7-7c41271ff077 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:37.964315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:37.965179 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:37.965459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:37.965735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] PATH_INFO: `/v3/projects/75618bfd209a42eba799515993c015a0/users/734f5754d5394f08843508d7f57b5646/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:37.980538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75618bfd209a42eba799515993c015a0, user_id=734f5754d5394f08843508d7f57b5646, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:37.983186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:38.050802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1263/2522] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:44:37 2022] PUT /identity/v3/projects/75618bfd209a42eba799515993c015a0/users/734f5754d5394f08843508d7f57b5646/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:44:38.061585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:38.061870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:38.062155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:38.093872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] MFA Rules not processed for user `734f5754d5394f08843508d7f57b5646`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:44:38.095369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:38.158361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1260/2523] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:44:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:44:38.170301 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:44:38.172015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:44:38.251805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf8925-378d-4935-af0d-e47575037d64 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:44:38.255570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b938e-5dc5-43fb-a7dc-76c49d50a87a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f37dda98124a8c8cf4406d985933f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:44:38.256214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b938e-5dc5-43fb-a7dc-76c49d50a87a service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:44:38.256496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b938e-5dc5-43fb-a7dc-76c49d50a87a service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:44:38.256954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b938e-5dc5-43fb-a7dc-76c49d50a87a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:44:38.265143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b938e-5dc5-43fb-a7dc-76c49d50a87a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:44:38.266570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b938e-5dc5-43fb-a7dc-76c49d50a87a service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:44:38.275338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1264/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:44:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:00.298094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:00.299550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:00.362578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df259d-95f4-45de-a96e-c41fa837d5a1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:00.367047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:00.367975 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:00.368259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:00.368547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] PATH_INFO: `/v3/users/030818ed3ef046beabd1188e377dea7b` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:00.369726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=030818ed3ef046beabd1188e377dea7b)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:00.371708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:00.539180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030818ed3ef046beabd1188e377dea7b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:00.594634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030818ed3ef046beabd1188e377dea7b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:00.607375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030818ed3ef046beabd1188e377dea7b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:00.608613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030818ed3ef046beabd1188e377dea7b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:00.616158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030818ed3ef046beabd1188e377dea7b'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:00.621965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1261/2525] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:00 2022] DELETE /identity/v3/users/030818ed3ef046beabd1188e377dea7b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:00.629485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:00.629485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:00.629485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:00.645173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:00.646364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:00.706173 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1265/2526] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:00.716012 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:00.717629 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:00.774147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996859c-135b-4c28-b9da-3ad81ce122ef admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:00.777794 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e55c0d-4243-43ab-a802-81418c938e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:00.778433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e55c0d-4243-43ab-a802-81418c938e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:00.778719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e55c0d-4243-43ab-a802-81418c938e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:00.778994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e55c0d-4243-43ab-a802-81418c938e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:00.788756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e55c0d-4243-43ab-a802-81418c938e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:00.790208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e55c0d-4243-43ab-a802-81418c938e42 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:00.804381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1262/2527] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:01.216858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:01.220030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:01.239259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ef311-70b6-43b9-b852-6a5cdb5eee4f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:01.244928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:01.245805 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.246086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.246357 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] PATH_INFO: `/v3/projects/ee4603ab074f4758ac49d42c5d44545b` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.247927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4603ab074f4758ac49d42c5d44545b)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:01.250870 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:01.342207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4603ab074f4758ac49d42c5d44545b', 'request_id': 'req-0da15f22-56b4-41fb-b6e9-b4e263718060'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:01.388650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4603ab074f4758ac49d42c5d44545b', 'request_id': 'req-0da15f22-56b4-41fb-b6e9-b4e263718060'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:01.395756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4603ab074f4758ac49d42c5d44545b', 'request_id': 'req-0da15f22-56b4-41fb-b6e9-b4e263718060'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:01.408333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] The token cache is being invalidate because project ee4603ab074f4758ac49d42c5d44545b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:01.408635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:01.409290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0da15f22-56b4-41fb-b6e9-b4e263718060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:01.410855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1266/2528] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:01 2022] DELETE /identity/v3/projects/ee4603ab074f4758ac49d42c5d44545b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:01.416101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a901-9179-470f-a14a-ee84d762e560 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.416597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a901-9179-470f-a14a-ee84d762e560 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.416867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4a901-9179-470f-a14a-ee84d762e560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.434860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-3ef4a901-9179-470f-a14a-ee84d762e560 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:01.436172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3ef4a901-9179-470f-a14a-ee84d762e560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:01.494884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1263/2529] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:01.504191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbd0c2-f76b-43d1-9624-f09d0d484419 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.504478 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbd0c2-f76b-43d1-9624-f09d0d484419 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.504759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbd0c2-f76b-43d1-9624-f09d0d484419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.523445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e0fbd0c2-f76b-43d1-9624-f09d0d484419 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:01.524569 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e0fbd0c2-f76b-43d1-9624-f09d0d484419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:01.534203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1267/2530] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:01.538720 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4a901-9179-470f-a14a-ee84d762e560 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:01.550283 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4a901-9179-470f-a14a-ee84d762e560 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:01.555062 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:01.555778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.556059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.556345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.557082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:45:01.557385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:01.559051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:01.574700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1264/2531] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:45:01.575949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbd0c2-f76b-43d1-9624-f09d0d484419 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:01.585259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbd0c2-f76b-43d1-9624-f09d0d484419 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:01.589955 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:01.590622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.590900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.591205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.591886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:01.594802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:01.682040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1268/2532] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:01 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:01.687060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:01.697169 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd239f97-601f-4836-83dd-4057a2b53d93 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:01.753866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:01.755007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.755556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.756116 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.757424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:01.760581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:01.837834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1265/2533] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:01 2022] POST /identity/v3/users => generated 287 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:01.838861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:01.849641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983e5d2-69e7-46f0-b4d7-140b427846cc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:01.854402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:01.855055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.856399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.856399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.856399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:01.858557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:01.869133 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1269/2534] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:01.873151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:01.883515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b9be9-e60d-47b6-83de-d2a4aea54af5 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:01.888143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f68c0e-a728-42d7-a440-7809555e7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:01.888806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68c0e-a728-42d7-a440-7809555e7787 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.889093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68c0e-a728-42d7-a440-7809555e7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.889607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f68c0e-a728-42d7-a440-7809555e7787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.890155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f68c0e-a728-42d7-a440-7809555e7787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:01.891869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f68c0e-a728-42d7-a440-7809555e7787 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:01.901869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1266/2535] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:01.906119 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:01.916195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0850f43-f17f-4dc2-bf6e-a69d5ab60210 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:01.921397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:01.922339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:01.922621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:01.922889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] PATH_INFO: `/v3/projects/e84b33f24f6d4a46b1e5ee4ed74ed39e/users/0a0c9edad1444469a9a31988ac49730f/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:01.937781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84b33f24f6d4a46b1e5ee4ed74ed39e, user_id=0a0c9edad1444469a9a31988ac49730f, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:01.940549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:02.052349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1270/2536] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:01 2022] PUT /identity/v3/projects/e84b33f24f6d4a46b1e5ee4ed74ed39e/users/0a0c9edad1444469a9a31988ac49730f/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:02.057607 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:02.057886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:02.058178 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:02.076379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:02.077807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:02.135210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1267/2537] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:02.144981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:02.146656 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:02.202380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5c473-a6a2-47c5-88a5-d4e2487f2ce0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:02.205981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f00bb5-2b3a-4644-b755-8a98937be44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:02.206625 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00bb5-2b3a-4644-b755-8a98937be44b service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:02.206906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00bb5-2b3a-4644-b755-8a98937be44b service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:02.207209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00bb5-2b3a-4644-b755-8a98937be44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:02.216027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f00bb5-2b3a-4644-b755-8a98937be44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:02.217996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f00bb5-2b3a-4644-b755-8a98937be44b service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:02.227800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1271/2538] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:02.605548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:02.608593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:02.624322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6dce8-63a9-4ed0-bf78-746fb952d220 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:02.629351 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:02.630249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:02.630756 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:02.631032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] PATH_INFO: `/v3/users/734f5754d5394f08843508d7f57b5646` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:02.632324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=734f5754d5394f08843508d7f57b5646)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:02.634258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:02.842143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '734f5754d5394f08843508d7f57b5646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:02.908709 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '734f5754d5394f08843508d7f57b5646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:02.920937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '734f5754d5394f08843508d7f57b5646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:02.921621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '734f5754d5394f08843508d7f57b5646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:02.928350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '734f5754d5394f08843508d7f57b5646'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:02.934120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1268/2539] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:02 2022] DELETE /identity/v3/users/734f5754d5394f08843508d7f57b5646 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:02.939872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7266b8-5fe1-49b1-bd6e-43f11b8532de None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:02.941811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7266b8-5fe1-49b1-bd6e-43f11b8532de None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:02.941811 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7266b8-5fe1-49b1-bd6e-43f11b8532de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:02.957878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3f7266b8-5fe1-49b1-bd6e-43f11b8532de None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:02.959140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3f7266b8-5fe1-49b1-bd6e-43f11b8532de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:03.017213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1272/2540] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:03.044675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:03.044675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:03.088113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc893ba-ea41-4e63-ae0a-a8c4348bc491 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:03.091680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:03.092389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.092726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.092726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.102066 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:03.103523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:03.113155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1269/2541] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:03.321449 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.326606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.326606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.360120 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] MFA Rules not processed for user `0a0c9edad1444469a9a31988ac49730f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:03.361383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:03.435860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1273/2542] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:03.446253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:03.448018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:03.507172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97774f8-43ed-4475-9341-954c98948622 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:03.510770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971282c-2d33-4ff7-bef5-8dc7b6a6ea73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:03.511447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971282c-2d33-4ff7-bef5-8dc7b6a6ea73 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.511734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971282c-2d33-4ff7-bef5-8dc7b6a6ea73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.512011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971282c-2d33-4ff7-bef5-8dc7b6a6ea73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.520495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971282c-2d33-4ff7-bef5-8dc7b6a6ea73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:03.521921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971282c-2d33-4ff7-bef5-8dc7b6a6ea73 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:03.526878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:03.528682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:03.533448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1270/2543] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:03.548636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03dd99-2f99-4894-9da4-00e84808245f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:03.554180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:03.555406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.555849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.556302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] PATH_INFO: `/v3/projects/75618bfd209a42eba799515993c015a0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.558072 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75618bfd209a42eba799515993c015a0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:03.560867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:03.651933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75618bfd209a42eba799515993c015a0', 'request_id': 'req-3499ca64-3a7a-4674-83eb-5e45b6bfb465'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:03.766439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75618bfd209a42eba799515993c015a0', 'request_id': 'req-3499ca64-3a7a-4674-83eb-5e45b6bfb465'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:03.772337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75618bfd209a42eba799515993c015a0', 'request_id': 'req-3499ca64-3a7a-4674-83eb-5e45b6bfb465'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:03.783512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] The token cache is being invalidate because project 75618bfd209a42eba799515993c015a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:03.783797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:03.784457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-3499ca64-3a7a-4674-83eb-5e45b6bfb465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:03.786129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1274/2544] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:03 2022] DELETE /identity/v3/projects/75618bfd209a42eba799515993c015a0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:45:03.790996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165104-67d8-4653-aa65-0d56738dca2d None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.791499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165104-67d8-4653-aa65-0d56738dca2d None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.795715 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f165104-67d8-4653-aa65-0d56738dca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.808889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0f165104-67d8-4653-aa65-0d56738dca2d None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:03.810111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0f165104-67d8-4653-aa65-0d56738dca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:03.868532 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1271/2545] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:03.877619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca4b9-4971-4f34-abeb-d46ee2b9571b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.877909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca4b9-4971-4f34-abeb-d46ee2b9571b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.878188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eca4b9-4971-4f34-abeb-d46ee2b9571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.896702 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-46eca4b9-4971-4f34-abeb-d46ee2b9571b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:03.897886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-46eca4b9-4971-4f34-abeb-d46ee2b9571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:03.910226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1275/2546] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:03.912304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165104-67d8-4653-aa65-0d56738dca2d None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:03.920951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f165104-67d8-4653-aa65-0d56738dca2d None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:03.926721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:03.927537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.927855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.928373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.928874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:45:03.929211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:03.930955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:03.944422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1272/2547] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:45:03.948787 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca4b9-4971-4f34-abeb-d46ee2b9571b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:03.959026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eca4b9-4971-4f34-abeb-d46ee2b9571b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:03.963764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15394f7-586a-475b-a228-395877477466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:03.964468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15394f7-586a-475b-a228-395877477466 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:03.964750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15394f7-586a-475b-a228-395877477466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:03.965026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15394f7-586a-475b-a228-395877477466 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:03.965713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15394f7-586a-475b-a228-395877477466 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:03.967906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15394f7-586a-475b-a228-395877477466 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:04.035433 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1276/2548] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:03 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:04.039570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:04.050394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6be8dc-0059-4e6b-8986-8706cfa47dd2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:04.106657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:04.109247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:04.109247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:04.109247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:04.109570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:04.111356 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:04.161104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1273/2549] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:04 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:45:04.164415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15394f7-586a-475b-a228-395877477466 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:04.175286 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15394f7-586a-475b-a228-395877477466 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:04.179980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:04.180642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:04.180924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:04.181203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:04.181930 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:04.183568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:04.195030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1277/2550] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:04.198962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:04.208996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13e84e-5044-444f-bf36-28c90e67d0c9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:04.215261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ace44-c0db-4a26-8c16-ba845529be94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:04.215261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ace44-c0db-4a26-8c16-ba845529be94 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:04.215261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ace44-c0db-4a26-8c16-ba845529be94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:04.215261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ace44-c0db-4a26-8c16-ba845529be94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:04.215759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ace44-c0db-4a26-8c16-ba845529be94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:04.217067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ace44-c0db-4a26-8c16-ba845529be94 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:04.227039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1274/2551] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:04.231370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:04.241825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac85ab00-9c60-4f7f-bd9a-169420b702e6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:04.246590 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:04.247494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:04.247782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:04.248064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] PATH_INFO: `/v3/projects/bf3b9b14eee94f66b2da7e002a02e45d/users/e8bb0e04a2d7489b949e2328deed6f6e/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:04.263523 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3b9b14eee94f66b2da7e002a02e45d, user_id=e8bb0e04a2d7489b949e2328deed6f6e, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:04.268600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:04.343113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1278/2552] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:04 2022] PUT /identity/v3/projects/bf3b9b14eee94f66b2da7e002a02e45d/users/e8bb0e04a2d7489b949e2328deed6f6e/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:04.353520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1fc0-09eb-4c43-859d-40953e760c1f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:04.353813 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1fc0-09eb-4c43-859d-40953e760c1f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:04.354124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b1fc0-09eb-4c43-859d-40953e760c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:04.381631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5e1b1fc0-09eb-4c43-859d-40953e760c1f None None] MFA Rules not processed for user `e8bb0e04a2d7489b949e2328deed6f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:04.382831 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5e1b1fc0-09eb-4c43-859d-40953e760c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:04.445472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1275/2553] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:04.456586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:04.458299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:04.515143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ff8c9-a247-4cab-a812-6fcbfccd0ef7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:04.518796 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:04.519460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:04.519744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:04.520027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:04.528548 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:04.530842 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:04.539581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1279/2554] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:05.190112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466bf08-fe3a-4258-b5cc-64be1187020f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:05.190602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466bf08-fe3a-4258-b5cc-64be1187020f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:05.190729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466bf08-fe3a-4258-b5cc-64be1187020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:05.209217 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e466bf08-fe3a-4258-b5cc-64be1187020f None None] MFA Rules not processed for user `0a0c9edad1444469a9a31988ac49730f`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:05.210427 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e466bf08-fe3a-4258-b5cc-64be1187020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:05.265410 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1276/2555] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:08.374395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:08.436723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6232c61-a41c-44d0-9b1a-32c46db8aa94 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:08.441959 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:08.442849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:08.443152 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:08.443426 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] PATH_INFO: `/v3/users/e8bb0e04a2d7489b949e2328deed6f6e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:08.444618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bb0e04a2d7489b949e2328deed6f6e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:08.446539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:08.620767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bb0e04a2d7489b949e2328deed6f6e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:08.628886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bb0e04a2d7489b949e2328deed6f6e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:08.708537 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bb0e04a2d7489b949e2328deed6f6e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:08.721221 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bb0e04a2d7489b949e2328deed6f6e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:08.721961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bb0e04a2d7489b949e2328deed6f6e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:08.728004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1280/2556] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:08 2022] DELETE /identity/v3/users/e8bb0e04a2d7489b949e2328deed6f6e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:08.732603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:08.733079 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:08.733381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:08.752123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:08.753488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:08.812516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1277/2557] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:45:08.822786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:08.824375 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:08.881161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0689395-3be6-46ed-bde6-73a8bb29d915 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:08.884894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186114f9-fd69-4b1a-a11a-8b50df93dbfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:08.885539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186114f9-fd69-4b1a-a11a-8b50df93dbfc service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:08.885818 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186114f9-fd69-4b1a-a11a-8b50df93dbfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:08.886093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186114f9-fd69-4b1a-a11a-8b50df93dbfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:08.895077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186114f9-fd69-4b1a-a11a-8b50df93dbfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:08.902626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186114f9-fd69-4b1a-a11a-8b50df93dbfc service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:08.906330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1281/2558] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:09.416856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:09.418313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:09.430667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1aff4-3ac6-4ba4-8d10-bf84cf41b8af None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:09.440820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:09.440820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:09.440820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:09.440820 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] PATH_INFO: `/v3/projects/bf3b9b14eee94f66b2da7e002a02e45d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:09.441634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3b9b14eee94f66b2da7e002a02e45d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:09.441634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:09.553172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3b9b14eee94f66b2da7e002a02e45d', 'request_id': 'req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:09.558747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3b9b14eee94f66b2da7e002a02e45d', 'request_id': 'req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:09.566291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3b9b14eee94f66b2da7e002a02e45d', 'request_id': 'req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:09.646480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] The token cache is being invalidate because project bf3b9b14eee94f66b2da7e002a02e45d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:09.646848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:09.647507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:09.649069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1278/2559] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:09 2022] DELETE /identity/v3/projects/bf3b9b14eee94f66b2da7e002a02e45d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:22.170392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:22.170869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:22.170869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:22.187814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] MFA Rules not processed for user `0a0c9edad1444469a9a31988ac49730f`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:22.188943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:22.246574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1282/2560] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:24.812473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:24.813951 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:24.898341 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbbedc-ea4e-43d3-8b35-f58329c3673f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:24.902983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:24.903881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:24.904474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:24.904748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:24.906696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:24.923049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:24.926643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:24.933694 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1279/2561] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:27.193318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:27.193318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:27.267888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88ea4b-4cd9-4161-999c-07bfe8330c92 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:27.275383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:27.276052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:27.276343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:27.276620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:27.278439 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:27.292757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:27.294365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:27.305728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1283/2562] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:45:35.012739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:35.022487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9277eb-a445-4b65-a264-928ebf66b473 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:35.026383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:35.027018 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:35.027324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:35.027598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:35.029349 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:35.092955 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:35.094392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:35.105456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1280/2563] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:39.212294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:39.213774 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:39.229067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56b3a0-d776-4924-b5ba-e1c5284acc32 service nova] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:39.234792 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:39.236052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:39.236333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:39.236610 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] PATH_INFO: `/v3/users/62bc5605a22d408f9b4bac69a0f5f486` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:39.237821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62bc5605a22d408f9b4bac69a0f5f486)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:39.240370 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:39.487850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62bc5605a22d408f9b4bac69a0f5f486'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:39.496817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62bc5605a22d408f9b4bac69a0f5f486'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:39.565607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62bc5605a22d408f9b4bac69a0f5f486'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:39.578562 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62bc5605a22d408f9b4bac69a0f5f486'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:39.579289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-54e518b7-e88b-4fe6-a84b-6dec3fb997e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62bc5605a22d408f9b4bac69a0f5f486'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:39.585554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1284/2564] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:39 2022] DELETE /identity/v3/users/62bc5605a22d408f9b4bac69a0f5f486 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:39.835225 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:39.845658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae8aed-8256-462e-9729-6df49889c530 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:39.906303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:39.907219 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:39.907507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:39.907787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] PATH_INFO: `/v3/projects/9582743483fa4fb88f4e91d3f787c945` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:39.908978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9582743483fa4fb88f4e91d3f787c945)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:39.911088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:40.011014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9582743483fa4fb88f4e91d3f787c945', 'request_id': 'req-2299c552-4d61-4e0d-991f-16e10a437132'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:40.016294 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9582743483fa4fb88f4e91d3f787c945', 'request_id': 'req-2299c552-4d61-4e0d-991f-16e10a437132'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:40.022257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9582743483fa4fb88f4e91d3f787c945', 'request_id': 'req-2299c552-4d61-4e0d-991f-16e10a437132'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:40.084267 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] The token cache is being invalidate because project 9582743483fa4fb88f4e91d3f787c945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:40.084493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:40.085118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2299c552-4d61-4e0d-991f-16e10a437132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:40.086706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1281/2565] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:39 2022] DELETE /identity/v3/projects/9582743483fa4fb88f4e91d3f787c945 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:40.091626 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83469660-bcbc-442c-be9a-8d14d987f696 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.091918 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83469660-bcbc-442c-be9a-8d14d987f696 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.092803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83469660-bcbc-442c-be9a-8d14d987f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.111343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-83469660-bcbc-442c-be9a-8d14d987f696 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:40.115989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-83469660-bcbc-442c-be9a-8d14d987f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:40.170636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1285/2566] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:40.178904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830b15-25b8-4d0e-a9ad-01a4ad124401 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.179229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830b15-25b8-4d0e-a9ad-01a4ad124401 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.179521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830b15-25b8-4d0e-a9ad-01a4ad124401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.198078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e0830b15-25b8-4d0e-a9ad-01a4ad124401 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:40.199322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e0830b15-25b8-4d0e-a9ad-01a4ad124401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:40.207152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1282/2567] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:40.211174 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83469660-bcbc-442c-be9a-8d14d987f696 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:40.220920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83469660-bcbc-442c-be9a-8d14d987f696 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:40.226103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:40.226755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.227036 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.227343 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.228066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:45:40.228369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:40.230076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:40.245620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1286/2568] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:45:40.246705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830b15-25b8-4d0e-a9ad-01a4ad124401 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:40.255725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830b15-25b8-4d0e-a9ad-01a4ad124401 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:40.260302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:40.260943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.261221 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.261495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.262214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:40.266886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:40.373330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1283/2569] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:40 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:45:40.377409 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:40.388154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9693c-d43a-4848-9559-66cad2a490fb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:40.445075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:40.446032 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.446340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.446628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.447598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:40.449566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:40.554178 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1287/2570] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:40 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:40.558333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:40.570755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d689a0-e752-47e0-beb1-7fd891ff1ddf admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:40.575507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:40.576170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.576452 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.576725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.577458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:40.579104 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:40.593288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1284/2571] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:40.594636 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:40.607253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91daa89-55ba-450e-a923-a496c2ae69bc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:40.612161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349a2cf-530c-458c-8fc7-00e8bb80fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:40.615810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a2cf-530c-458c-8fc7-00e8bb80fb11 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.615810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a2cf-530c-458c-8fc7-00e8bb80fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.615810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349a2cf-530c-458c-8fc7-00e8bb80fb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.615810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349a2cf-530c-458c-8fc7-00e8bb80fb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:40.616525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4349a2cf-530c-458c-8fc7-00e8bb80fb11 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:40.627910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1288/2572] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:40.632763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:40.642744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc677840-da41-49c0-bf96-dba8ab2dd205 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:40.648702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:40.649633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.649915 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.650187 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] PATH_INFO: `/v3/projects/dea71ea00d7d4dc2aba19edb20a58123/users/da565c942a6d49bca9d7f5fe0cc42ea0/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.665209 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea71ea00d7d4dc2aba19edb20a58123, user_id=da565c942a6d49bca9d7f5fe0cc42ea0, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:40.667926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:40.772062 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1285/2573] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:40 2022] PUT /identity/v3/projects/dea71ea00d7d4dc2aba19edb20a58123/users/da565c942a6d49bca9d7f5fe0cc42ea0/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:40.782957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda499-9093-4ed8-823a-2c4337b6ab58 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.783273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda499-9093-4ed8-823a-2c4337b6ab58 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.783547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda499-9093-4ed8-823a-2c4337b6ab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.809882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-69bda499-9093-4ed8-823a-2c4337b6ab58 None None] MFA Rules not processed for user `da565c942a6d49bca9d7f5fe0cc42ea0`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:40.811074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-69bda499-9093-4ed8-823a-2c4337b6ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:40.879191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1289/2574] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:40.884358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:40.946152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99eabce-9c1b-4e1a-ac36-3953c30d9de0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:40.950727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:40.951445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:40.951728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:40.952002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:40.952696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:40.957198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.059589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1286/2575] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:40 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:41.063416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bda499-9093-4ed8-823a-2c4337b6ab58 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:41.074049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bda499-9093-4ed8-823a-2c4337b6ab58 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:41.131096 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:41.131740 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.132022 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.132293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.133099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:41.135229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.216913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1290/2576] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:41 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:41.221155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:41.232044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689283a9-a915-4754-b0b8-efdac57a52bb admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:41.236626 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:41.237276 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.237561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.237841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.238624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:41.240935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.251690 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1287/2577] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:41.255825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:41.266045 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6bec-f230-443d-bf3a-174b65e4a2cf admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:41.271051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:41.271953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.272232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.272512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] PATH_INFO: `/v3/projects/ce3fee21a8e846289b4e2f672df1ab9f/users/b05f44e0b1cf4eba9c6cff7ef076bb76/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.288033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3fee21a8e846289b4e2f672df1ab9f, user_id=b05f44e0b1cf4eba9c6cff7ef076bb76, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:41.290671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.360360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1291/2578] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:41 2022] PUT /identity/v3/projects/ce3fee21a8e846289b4e2f672df1ab9f/users/b05f44e0b1cf4eba9c6cff7ef076bb76/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:41.365004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:41.377634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257999dc-c8be-4291-bce0-8eb7d5ca7871 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:41.438197 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440ae0-fdca-470a-99ba-722d3a903e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:41.438906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440ae0-fdca-470a-99ba-722d3a903e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.439222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440ae0-fdca-470a-99ba-722d3a903e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.439505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440ae0-fdca-470a-99ba-722d3a903e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.440231 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440ae0-fdca-470a-99ba-722d3a903e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:41.441825 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440ae0-fdca-470a-99ba-722d3a903e32 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.455392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1288/2579] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:41.457026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:41.468502 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4711abe4-39bd-4f2e-a7dd-82782c65ead5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:41.474322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:41.475199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.475475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.475746 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] PATH_INFO: `/v3/projects/ce3fee21a8e846289b4e2f672df1ab9f/users/b05f44e0b1cf4eba9c6cff7ef076bb76/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.477804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3fee21a8e846289b4e2f672df1ab9f, user_id=b05f44e0b1cf4eba9c6cff7ef076bb76, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:41.480527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.492826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1292/2580] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:41 2022] PUT /identity/v3/projects/ce3fee21a8e846289b4e2f672df1ab9f/users/b05f44e0b1cf4eba9c6cff7ef076bb76/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:45:41.502769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1383a-7bda-49c4-bb97-488a1c1b53ba None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.503310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1383a-7bda-49c4-bb97-488a1c1b53ba None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.503754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1383a-7bda-49c4-bb97-488a1c1b53ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.537547 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-63c1383a-7bda-49c4-bb97-488a1c1b53ba None None] MFA Rules not processed for user `b05f44e0b1cf4eba9c6cff7ef076bb76`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:41.539080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-63c1383a-7bda-49c4-bb97-488a1c1b53ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:41.616728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1289/2581] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:41.628262 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:41.630585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:41.691198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdbee77-fc7a-470d-aad2-d79a61ac8fd2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:41.695450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a51a77-cdcd-45bf-94d0-8a68840b04f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:41.696089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51a77-cdcd-45bf-94d0-8a68840b04f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.696368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51a77-cdcd-45bf-94d0-8a68840b04f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.696642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a51a77-cdcd-45bf-94d0-8a68840b04f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.705477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a51a77-cdcd-45bf-94d0-8a68840b04f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:41.706892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a51a77-cdcd-45bf-94d0-8a68840b04f2 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.716316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1293/2582] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:41.782741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1383a-7bda-49c4-bb97-488a1c1b53ba None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:41.843977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c1383a-7bda-49c4-bb97-488a1c1b53ba None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:41.849263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:41.850120 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:41.850399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:41.850671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] PATH_INFO: `/v3/users/da565c942a6d49bca9d7f5fe0cc42ea0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:41.851876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] RBAC: Authorizing `identity:delete_user(user_id=da565c942a6d49bca9d7f5fe0cc42ea0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:41.853784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:41.995382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da565c942a6d49bca9d7f5fe0cc42ea0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.056519 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da565c942a6d49bca9d7f5fe0cc42ea0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.068993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da565c942a6d49bca9d7f5fe0cc42ea0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.070313 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da565c942a6d49bca9d7f5fe0cc42ea0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.076293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da565c942a6d49bca9d7f5fe0cc42ea0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.082040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1290/2583] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:41 2022] DELETE /identity/v3/users/da565c942a6d49bca9d7f5fe0cc42ea0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:42.087213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:42.087503 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:42.087780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:42.105338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:42.106516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:42.165467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1294/2584] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:42.175091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:42.176531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:42.232292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7077a5-fd1f-4b79-be1f-7499eed3e74a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:42.235984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:42.236634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:42.237183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:42.237183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:42.246464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:42.247856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:42.257055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1291/2585] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:42.657447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:42.658944 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:42.674419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e767137-5be8-4194-8548-14e00a3a01ef None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:42.688453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:42.689358 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:42.689659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:42.689933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] PATH_INFO: `/v3/projects/dea71ea00d7d4dc2aba19edb20a58123` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:42.691157 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea71ea00d7d4dc2aba19edb20a58123)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:42.693796 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:42.819627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea71ea00d7d4dc2aba19edb20a58123', 'request_id': 'req-ccf44673-410a-46b2-8546-6c43ba10009f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.885331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea71ea00d7d4dc2aba19edb20a58123', 'request_id': 'req-ccf44673-410a-46b2-8546-6c43ba10009f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.890954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea71ea00d7d4dc2aba19edb20a58123', 'request_id': 'req-ccf44673-410a-46b2-8546-6c43ba10009f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.902097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] The token cache is being invalidate because project dea71ea00d7d4dc2aba19edb20a58123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:42.902382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.903005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:42.904563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1295/2586] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:42 2022] DELETE /identity/v3/projects/dea71ea00d7d4dc2aba19edb20a58123 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:42.908634 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:42.918667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a3990-9760-4efa-8683-d9e325ec7b61 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:42.974639 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:42.975544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:42.975834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:42.976113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] PATH_INFO: `/v3/users/b05f44e0b1cf4eba9c6cff7ef076bb76` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:42.977309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05f44e0b1cf4eba9c6cff7ef076bb76)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:42.979265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:43.116074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05f44e0b1cf4eba9c6cff7ef076bb76'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.171033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05f44e0b1cf4eba9c6cff7ef076bb76'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.183814 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05f44e0b1cf4eba9c6cff7ef076bb76'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.188823 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05f44e0b1cf4eba9c6cff7ef076bb76'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.191315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4be715a-7631-4d9f-a75a-00e36549e4fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05f44e0b1cf4eba9c6cff7ef076bb76'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.197946 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1292/2587] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:42 2022] DELETE /identity/v3/users/b05f44e0b1cf4eba9c6cff7ef076bb76 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:43.583919 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:43.585329 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:43.599029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf44673-410a-46b2-8546-6c43ba10009f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:43.662981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:43.663790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:43.664077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:43.664380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] PATH_INFO: `/v3/projects/ce3fee21a8e846289b4e2f672df1ab9f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:43.665572 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3fee21a8e846289b4e2f672df1ab9f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:43.667559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:43.790484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3fee21a8e846289b4e2f672df1ab9f', 'request_id': 'req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.885267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3fee21a8e846289b4e2f672df1ab9f', 'request_id': 'req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.891103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3fee21a8e846289b4e2f672df1ab9f', 'request_id': 'req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.902570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] The token cache is being invalidate because project ce3fee21a8e846289b4e2f672df1ab9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:43.902927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.903560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-9dab34f5-8ee9-40c0-9ec1-ec7ac4173ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:43.905097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1296/2588] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:43 2022] DELETE /identity/v3/projects/ce3fee21a8e846289b4e2f672df1ab9f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:43.910049 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eb25f-b84c-4f61-98e3-cd683b31e385 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:43.910339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eb25f-b84c-4f61-98e3-cd683b31e385 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:43.910615 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eb25f-b84c-4f61-98e3-cd683b31e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:43.934475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ec2eb25f-b84c-4f61-98e3-cd683b31e385 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:43.934475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ec2eb25f-b84c-4f61-98e3-cd683b31e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:43.987343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1293/2589] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:43.994902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634226af-f4ac-4de7-9f57-98599d327153 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:43.995259 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634226af-f4ac-4de7-9f57-98599d327153 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:43.995546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634226af-f4ac-4de7-9f57-98599d327153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.013974 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-634226af-f4ac-4de7-9f57-98599d327153 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:44.015196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-634226af-f4ac-4de7-9f57-98599d327153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:44.023088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1297/2590] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:44.027139 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eb25f-b84c-4f61-98e3-cd683b31e385 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.037047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eb25f-b84c-4f61-98e3-cd683b31e385 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.041522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.042166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.042448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.042721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.043473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:45:44.043780 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.045364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.057081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1294/2591] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:45:44.061166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634226af-f4ac-4de7-9f57-98599d327153 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.070057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634226af-f4ac-4de7-9f57-98599d327153 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.074680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.075356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.075638 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.075911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.076604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.078482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.177927 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1298/2592] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:44 2022] POST /identity/v3/projects => generated 399 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:44.182015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.191836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85371fec-6811-4ed2-bc19-7c01c1c83beb admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.246776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.247476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.247762 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.248037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.248730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.250645 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.313562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1295/2593] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:44 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:44.317954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.329092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ffcc-72a1-47f2-be02-67b73ef7df4a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.333824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.334474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.334760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.335040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.335835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.337429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.348075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1299/2594] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:44.353041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.362982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d6f2a-4035-483a-8672-541bbc7edb29 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.368358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b99367-c3a0-42e0-b964-15598a4f1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.369000 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b99367-c3a0-42e0-b964-15598a4f1040 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.369286 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b99367-c3a0-42e0-b964-15598a4f1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.369560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b99367-c3a0-42e0-b964-15598a4f1040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.370391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b99367-c3a0-42e0-b964-15598a4f1040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.371998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b99367-c3a0-42e0-b964-15598a4f1040 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.381628 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1296/2595] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:44.385598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.395378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e870a-8a1a-45b0-a64e-61f13db8f411 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.400228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.401148 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.401435 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.401712 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] PATH_INFO: `/v3/projects/1774f2f29ea54a32b73ea363b8eff9c5/users/632fbd2e0eff467c8b87321a50826cbe/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.417093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1774f2f29ea54a32b73ea363b8eff9c5, user_id=632fbd2e0eff467c8b87321a50826cbe, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.419830 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.480216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1300/2596] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:44 2022] PUT /identity/v3/projects/1774f2f29ea54a32b73ea363b8eff9c5/users/632fbd2e0eff467c8b87321a50826cbe/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:44.493227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c2d0-6129-44a9-8b1c-d13a502fa4c6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.493518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c2d0-6129-44a9-8b1c-d13a502fa4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.493797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c2d0-6129-44a9-8b1c-d13a502fa4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.519917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6af9c2d0-6129-44a9-8b1c-d13a502fa4c6 None None] MFA Rules not processed for user `632fbd2e0eff467c8b87321a50826cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:44.521242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6af9c2d0-6129-44a9-8b1c-d13a502fa4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:44.584216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1297/2597] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:45:44.588795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.651570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ac447-472f-491d-9e59-d45d67d8f713 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.656229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.656878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.657159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.657450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.658120 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.660046 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.732410 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1301/2598] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:44 2022] POST /identity/v3/projects => generated 401 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:44.736468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c2d0-6129-44a9-8b1c-d13a502fa4c6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.747291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c2d0-6129-44a9-8b1c-d13a502fa4c6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.803699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.804423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.804723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.805001 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.805713 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.807656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.862265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1298/2599] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:44 2022] POST /identity/v3/users => generated 307 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:44.868188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.878206 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b76d21-6c37-46c3-81c7-094257c0f1d0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.883533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.884214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.884499 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.884806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.885530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.887132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:44.898601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1302/2600] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:44.903024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:44.913156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7967-88fe-499d-974a-41f29c6ec208 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:44.918149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:44.919028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:44.919332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:44.919608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] PATH_INFO: `/v3/projects/37f7d3a4c1394d299cd28c06c9eb23e9/users/05d97f9faa324916b8714ed9023f9cf8/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:44.934808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f7d3a4c1394d299cd28c06c9eb23e9, user_id=05d97f9faa324916b8714ed9023f9cf8, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:44.937489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:45.016705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1299/2601] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:44 2022] PUT /identity/v3/projects/37f7d3a4c1394d299cd28c06c9eb23e9/users/05d97f9faa324916b8714ed9023f9cf8/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:45.020822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:45.030876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a494a-a5c5-428a-bb03-fd68ca818e5f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:45.086783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550689-b68e-4f2a-b6dd-40f805943a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:45.087491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550689-b68e-4f2a-b6dd-40f805943a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:45.087769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550689-b68e-4f2a-b6dd-40f805943a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:45.088042 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550689-b68e-4f2a-b6dd-40f805943a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:45.088763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550689-b68e-4f2a-b6dd-40f805943a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:45.090354 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550689-b68e-4f2a-b6dd-40f805943a6e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:45.100424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1303/2602] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:45.104553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:45.115261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243e339-c81c-4423-ad1c-e0f827e79f7e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:45.120019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:45.122185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:45.122185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:45.122185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] PATH_INFO: `/v3/projects/37f7d3a4c1394d299cd28c06c9eb23e9/users/05d97f9faa324916b8714ed9023f9cf8/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:45.123386 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f7d3a4c1394d299cd28c06c9eb23e9, user_id=05d97f9faa324916b8714ed9023f9cf8, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:45.125993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:45.136914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1300/2603] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:45 2022] PUT /identity/v3/projects/37f7d3a4c1394d299cd28c06c9eb23e9/users/05d97f9faa324916b8714ed9023f9cf8/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:45.146836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381f1d5-1387-4b57-8fc3-70aeed0427aa None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:45.147150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381f1d5-1387-4b57-8fc3-70aeed0427aa None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:45.147447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381f1d5-1387-4b57-8fc3-70aeed0427aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:45.174135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-6381f1d5-1387-4b57-8fc3-70aeed0427aa None None] MFA Rules not processed for user `05d97f9faa324916b8714ed9023f9cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:45.175374 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6381f1d5-1387-4b57-8fc3-70aeed0427aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:45.244101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1304/2604] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:45:45.254559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:45.256661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:45.313695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20650b4a-ac92-445e-90c7-36c85fc66a86 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:45.317471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85eeb-a89d-4fb9-bbb9-684449f08d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:45.318113 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85eeb-a89d-4fb9-bbb9-684449f08d99 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:45.318424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85eeb-a89d-4fb9-bbb9-684449f08d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:45.318700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85eeb-a89d-4fb9-bbb9-684449f08d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:45.327455 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85eeb-a89d-4fb9-bbb9-684449f08d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:45.328878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85eeb-a89d-4fb9-bbb9-684449f08d99 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:45.338292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1301/2605] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:45.517551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381f1d5-1387-4b57-8fc3-70aeed0427aa None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:45.530863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381f1d5-1387-4b57-8fc3-70aeed0427aa None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:45.535424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:45.536546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:45.537500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:45.537500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:45.599863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:45.601469 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:45.610899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1305/2606] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:45.643277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcb07-f340-402a-9353-b27d480b192a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:45.643850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcb07-f340-402a-9353-b27d480b192a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:45.644179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dcb07-f340-402a-9353-b27d480b192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:45.705869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ae2dcb07-f340-402a-9353-b27d480b192a None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:45.707099 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ae2dcb07-f340-402a-9353-b27d480b192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:45.782470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1302/2607] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:45:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:45.922534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:45.922534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:46.011514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c598b79-f092-407b-8258-aab3738b8da5 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:46.016675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fec43-c83d-4d0f-b85b-ab63f7670b27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:46.017316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fec43-c83d-4d0f-b85b-ab63f7670b27 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:46.017598 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fec43-c83d-4d0f-b85b-ab63f7670b27 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:46.017898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fec43-c83d-4d0f-b85b-ab63f7670b27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:46.026909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fec43-c83d-4d0f-b85b-ab63f7670b27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:46.031247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fec43-c83d-4d0f-b85b-ab63f7670b27 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:46.036686 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1306/2608] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:45:50.774983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dcb07-f340-402a-9353-b27d480b192a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:50.857358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dcb07-f340-402a-9353-b27d480b192a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:50.864503 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:50.865613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:50.866094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:50.866375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] PATH_INFO: `/v3/users/632fbd2e0eff467c8b87321a50826cbe` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:50.868107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=632fbd2e0eff467c8b87321a50826cbe)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:50.870243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:51.066659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632fbd2e0eff467c8b87321a50826cbe'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:51.126059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632fbd2e0eff467c8b87321a50826cbe'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:51.140616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632fbd2e0eff467c8b87321a50826cbe'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:51.141472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632fbd2e0eff467c8b87321a50826cbe'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:51.149290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632fbd2e0eff467c8b87321a50826cbe'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:51.155685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1303/2609] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:50 2022] DELETE /identity/v3/users/632fbd2e0eff467c8b87321a50826cbe => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:51.160115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:51.160607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:51.160742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:51.181527 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:51.182815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:51.271107 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1307/2610] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:51.280304 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:51.281832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:51.354485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227ca738-651d-4c66-aff0-1d787e364a3c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:51.358275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:51.358927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:51.359299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:51.359558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:51.369011 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:51.370435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:51.380227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1304/2611] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:51.829793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:51.831243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:51.854601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973c6a8-7920-44d4-b3c5-8741f6484532 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:51.859988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:51.862549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:51.862549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:51.862549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] PATH_INFO: `/v3/projects/1774f2f29ea54a32b73ea363b8eff9c5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:51.864738 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1774f2f29ea54a32b73ea363b8eff9c5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:51.867165 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:51.995489 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1774f2f29ea54a32b73ea363b8eff9c5', 'request_id': 'req-cf72b9b9-40a9-4570-9f77-3486878d8c64'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.071112 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1774f2f29ea54a32b73ea363b8eff9c5', 'request_id': 'req-cf72b9b9-40a9-4570-9f77-3486878d8c64'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.077632 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1774f2f29ea54a32b73ea363b8eff9c5', 'request_id': 'req-cf72b9b9-40a9-4570-9f77-3486878d8c64'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.090753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] The token cache is being invalidate because project 1774f2f29ea54a32b73ea363b8eff9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:52.091231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.092234 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.097216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1308/2612] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:51 2022] DELETE /identity/v3/projects/1774f2f29ea54a32b73ea363b8eff9c5 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:52.098799 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:52.109319 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026bbdd-9a03-4d4a-803d-ee8f37950620 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:52.185328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:52.186209 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:52.186502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:52.186777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] PATH_INFO: `/v3/users/05d97f9faa324916b8714ed9023f9cf8` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:52.189172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d97f9faa324916b8714ed9023f9cf8)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:52.192995 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:52.397530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d97f9faa324916b8714ed9023f9cf8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.469292 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d97f9faa324916b8714ed9023f9cf8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.488108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d97f9faa324916b8714ed9023f9cf8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.489384 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d97f9faa324916b8714ed9023f9cf8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.496590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0aaeb384-8dd5-4332-8b09-410f66344c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d97f9faa324916b8714ed9023f9cf8'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:52.505458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1305/2613] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:45:52 2022] DELETE /identity/v3/users/05d97f9faa324916b8714ed9023f9cf8 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:45:53.054186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:53.055673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:53.070187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72b9b9-40a9-4570-9f77-3486878d8c64 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:53.148814 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:53.149887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.150266 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.150647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] PATH_INFO: `/v3/projects/37f7d3a4c1394d299cd28c06c9eb23e9` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.152098 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f7d3a4c1394d299cd28c06c9eb23e9)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:53.154222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:53.252658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f7d3a4c1394d299cd28c06c9eb23e9', 'request_id': 'req-ee076d0a-1954-4d44-be95-30fc7ea73700'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:53.330366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f7d3a4c1394d299cd28c06c9eb23e9', 'request_id': 'req-ee076d0a-1954-4d44-be95-30fc7ea73700'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:53.340964 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f7d3a4c1394d299cd28c06c9eb23e9', 'request_id': 'req-ee076d0a-1954-4d44-be95-30fc7ea73700'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:53.356057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] The token cache is being invalidate because project 37f7d3a4c1394d299cd28c06c9eb23e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:45:53.356486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:53.357217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ee076d0a-1954-4d44-be95-30fc7ea73700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:45:53.358891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1309/2614] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:45:53 2022] DELETE /identity/v3/projects/37f7d3a4c1394d299cd28c06c9eb23e9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:53.364843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddb45c-ef71-4f85-9b00-05991b388d3b None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.365433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddb45c-ef71-4f85-9b00-05991b388d3b None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.365878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eddb45c-ef71-4f85-9b00-05991b388d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.388246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1eddb45c-ef71-4f85-9b00-05991b388d3b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:53.389667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1eddb45c-ef71-4f85-9b00-05991b388d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:53.469758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1306/2615] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:53.478880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b2896-252f-4397-8e63-71fc38bb68a5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.479424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b2896-252f-4397-8e63-71fc38bb68a5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.479900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b2896-252f-4397-8e63-71fc38bb68a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.500826 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-478b2896-252f-4397-8e63-71fc38bb68a5 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:53.502332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-478b2896-252f-4397-8e63-71fc38bb68a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:53.512596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1310/2616] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:45:53.516526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddb45c-ef71-4f85-9b00-05991b388d3b None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:53.527788 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eddb45c-ef71-4f85-9b00-05991b388d3b None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:53.532591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:53.533261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.533601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.533816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.534554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:45:53.534860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:53.536700 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:53.548797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1307/2617] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:45:53.553349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b2896-252f-4397-8e63-71fc38bb68a5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:53.563332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b2896-252f-4397-8e63-71fc38bb68a5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:53.569436 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:53.570104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.570385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.570660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.571402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:53.573443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:53.660732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1311/2618] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:53 2022] POST /identity/v3/projects => generated 409 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:45:53.665250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:53.677378 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e15fa73-27dc-4922-8635-246717e32798 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:53.744324 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:53.745336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.745791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.746078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.746792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:53.748739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:53.840208 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1308/2619] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:53 2022] POST /identity/v3/users => generated 305 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:45:53.842011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:53.856824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411dc67-5f3c-4872-9f57-4fe93b32f884 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:53.867060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:53.867060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.867060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.867060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.867573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:53.867573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:53.880904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1312/2620] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:53.885041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:53.896407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0980ad-eda5-412a-b486-f4ada24c6b7d admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:53.901770 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f2d2-cc2c-43ed-9889-82793442b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:53.902561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f2d2-cc2c-43ed-9889-82793442b74c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.902943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f2d2-cc2c-43ed-9889-82793442b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.903361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f2d2-cc2c-43ed-9889-82793442b74c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.904382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f2d2-cc2c-43ed-9889-82793442b74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:53.906108 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f2d2-cc2c-43ed-9889-82793442b74c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:53.920984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1309/2621] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:53.922311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:53.933533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dacc89-c131-4b6b-9bfb-ec1435ab5918 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:53.938655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:53.939585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:53.939865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:53.940142 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] PATH_INFO: `/v3/projects/accf71ecdabe405582ee44108f73b1b0/users/9556d337cc6b4b2789faf8a1df7e54de/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:53.958655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=accf71ecdabe405582ee44108f73b1b0, user_id=9556d337cc6b4b2789faf8a1df7e54de, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:53.961466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:54.474290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1313/2622] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:53 2022] PUT /identity/v3/projects/accf71ecdabe405582ee44108f73b1b0/users/9556d337cc6b4b2789faf8a1df7e54de/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:45:54.488705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484433-ec4f-4aa1-ad7c-730b930818ab None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:54.489233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484433-ec4f-4aa1-ad7c-730b930818ab None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:54.489348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484433-ec4f-4aa1-ad7c-730b930818ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:54.515595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-75484433-ec4f-4aa1-ad7c-730b930818ab None None] MFA Rules not processed for user `9556d337cc6b4b2789faf8a1df7e54de`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:54.516810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-75484433-ec4f-4aa1-ad7c-730b930818ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:54.584335 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1310/2623] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:54.588810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:54.694231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e387acb-430d-40a5-914b-8abf4f616c9c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:54.699511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:54.701966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:54.701966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:54.701966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:54.701966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:54.703995 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:54.825207 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484433-ec4f-4aa1-ad7c-730b930818ab None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:54.825612 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1314/2624] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:45:54 2022] POST /identity/v3/projects => generated 409 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:45:54.839884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484433-ec4f-4aa1-ad7c-730b930818ab None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:54.907309 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:54.908326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:54.908803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:54.909255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:54.910128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:54.912957 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:55.028512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1311/2625] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:45:54 2022] POST /identity/v3/users => generated 311 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:45:55.030155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:55.044144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97372c0b-b603-4dc2-be3f-1d1ff232c0df admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:55.049475 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:55.050474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:55.050718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:55.051167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:55.053120 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:55.054896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:55.068912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1315/2626] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:55.081548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:55.096233 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be9b6a-886f-456c-bb1e-d97a10254623 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:55.101732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:55.102778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:55.103188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:55.103624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] PATH_INFO: `/v3/projects/2232471cfac04d44b8dc4e41ac100210/users/5b0df12642ac4a1792b91368c5bbd172/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:55.125696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2232471cfac04d44b8dc4e41ac100210, user_id=5b0df12642ac4a1792b91368c5bbd172, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:55.130596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:55.232192 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1312/2627] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:55 2022] PUT /identity/v3/projects/2232471cfac04d44b8dc4e41ac100210/users/5b0df12642ac4a1792b91368c5bbd172/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:45:55.235215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:55.249154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee103c9-1ff0-471c-849c-53533f941a96 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:55.317940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cad789-9cc3-4408-abdf-771abaa8b6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:55.319226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cad789-9cc3-4408-abdf-771abaa8b6be admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:55.319730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cad789-9cc3-4408-abdf-771abaa8b6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:55.320269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cad789-9cc3-4408-abdf-771abaa8b6be admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:55.321211 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cad789-9cc3-4408-abdf-771abaa8b6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:55.323057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cad789-9cc3-4408-abdf-771abaa8b6be admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:55.334486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1316/2628] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:45:55.338570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:55.351758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023d361-ff59-4819-a6f3-41384020148e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:55.356375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:55.357251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:55.357528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:55.357800 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] PATH_INFO: `/v3/projects/2232471cfac04d44b8dc4e41ac100210/users/5b0df12642ac4a1792b91368c5bbd172/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:55.361891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2232471cfac04d44b8dc4e41ac100210, user_id=5b0df12642ac4a1792b91368c5bbd172, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:55.367550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:55.383554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1313/2629] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:45:55 2022] PUT /identity/v3/projects/2232471cfac04d44b8dc4e41ac100210/users/5b0df12642ac4a1792b91368c5bbd172/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:45:55.396984 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db757dd-fb3e-4c54-93bc-343fb873f043 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:55.397275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db757dd-fb3e-4c54-93bc-343fb873f043 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:55.397558 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db757dd-fb3e-4c54-93bc-343fb873f043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:55.429872 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-5db757dd-fb3e-4c54-93bc-343fb873f043 None None] MFA Rules not processed for user `5b0df12642ac4a1792b91368c5bbd172`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:45:55.431356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5db757dd-fb3e-4c54-93bc-343fb873f043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:55.537988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1317/2630] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:45:55 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:45:55.550590 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:55.553014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:45:55.628160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bfe748-029d-4117-aeff-d5f5a0b765cd admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:55.634429 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5284696-5036-49ab-95c7-c0ce8b19a2c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:55.635735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284696-5036-49ab-95c7-c0ce8b19a2c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:55.635735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284696-5036-49ab-95c7-c0ce8b19a2c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:55.636249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5284696-5036-49ab-95c7-c0ce8b19a2c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:55.648019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5284696-5036-49ab-95c7-c0ce8b19a2c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:55.649676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5284696-5036-49ab-95c7-c0ce8b19a2c5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:55.661981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1314/2631] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:55 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:45:56.054658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db757dd-fb3e-4c54-93bc-343fb873f043 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:45:56.065887 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db757dd-fb3e-4c54-93bc-343fb873f043 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:45:56.071556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:45:56.072305 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:45:56.072583 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:45:56.072831 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:45:56.139175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:45:56.140913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:45:56.152137 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1318/2632] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:45:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:02.226252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:02.226758 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:02.226876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:02.244528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:02.245738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:02.302201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1315/2633] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 21:46:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:02.314336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:02.315755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:02.383025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7635680b-4987-44a2-b6aa-c35cb34110ba service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:02.387860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:02.388495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:02.388774 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:02.389048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:02.398075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:02.399677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:02.407594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1319/2634] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:46:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:46:05.263889 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:05.265320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:05.331173 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ef3cd-6fe8-498f-82b3-111fc3307df0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:05.336035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:05.336906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:05.337174 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:05.337446 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] PATH_INFO: `/v3/users/0a0c9edad1444469a9a31988ac49730f` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:05.338635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0c9edad1444469a9a31988ac49730f)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:05.340561 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:05.464938 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0c9edad1444469a9a31988ac49730f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:05.553881 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0c9edad1444469a9a31988ac49730f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:05.566069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0c9edad1444469a9a31988ac49730f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:05.566761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0c9edad1444469a9a31988ac49730f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:05.574057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0c9edad1444469a9a31988ac49730f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:05.580363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1316/2635] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:05 2022] DELETE /identity/v3/users/0a0c9edad1444469a9a31988ac49730f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:05.862928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:05.874318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd8ab7-d751-45dc-86d2-f3d73043b3c3 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:05.932346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:05.933130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:05.933417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:05.933699 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] PATH_INFO: `/v3/projects/e84b33f24f6d4a46b1e5ee4ed74ed39e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:05.934911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84b33f24f6d4a46b1e5ee4ed74ed39e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:05.936853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.062616 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'request_id': 'req-0e8f744d-ac72-40de-8496-2c7f81dda073'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.147732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'request_id': 'req-0e8f744d-ac72-40de-8496-2c7f81dda073'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.158355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84b33f24f6d4a46b1e5ee4ed74ed39e', 'request_id': 'req-0e8f744d-ac72-40de-8496-2c7f81dda073'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.158833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.160297 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:06.170467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] The token cache is being invalidate because project e84b33f24f6d4a46b1e5ee4ed74ed39e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:06.170836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.171568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-0e8f744d-ac72-40de-8496-2c7f81dda073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.173254 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1320/2636] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:05 2022] DELETE /identity/v3/projects/e84b33f24f6d4a46b1e5ee4ed74ed39e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:06.178114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e46b3-0f5b-45df-bd83-905defd0773b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.181064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5985d-355c-498d-96e8-5256c3cad461 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.181064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5985d-355c-498d-96e8-5256c3cad461 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.181064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5985d-355c-498d-96e8-5256c3cad461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.198769 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0ed5985d-355c-498d-96e8-5256c3cad461 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:06.199942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0ed5985d-355c-498d-96e8-5256c3cad461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:06.235618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.239402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.239402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.239402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] PATH_INFO: `/v3/users/9556d337cc6b4b2789faf8a1df7e54de` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.239402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9556d337cc6b4b2789faf8a1df7e54de)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.240256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.259624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1321/2637] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:46:06.267559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4a57-7628-4ce4-942b-63a08232ca26 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.267844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4a57-7628-4ce4-942b-63a08232ca26 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.268118 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ff4a57-7628-4ce4-942b-63a08232ca26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.286755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-91ff4a57-7628-4ce4-942b-63a08232ca26 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:06.288093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-91ff4a57-7628-4ce4-942b-63a08232ca26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:06.295844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1322/2638] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:46:06.299793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff4a57-7628-4ce4-942b-63a08232ca26 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.308630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ff4a57-7628-4ce4-942b-63a08232ca26 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.313127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.313736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.314016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.314289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.314993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:46:06.315331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.316901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.328273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1323/2639] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 10 21:46:06.332273 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.342401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c5b5-8090-4b8c-9aad-80c719c43567 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.347330 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.347962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.348243 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.349244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.349828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.351754 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.418774 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9556d337cc6b4b2789faf8a1df7e54de'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.476294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1324/2640] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:06 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:06.480529 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.530976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9556d337cc6b4b2789faf8a1df7e54de'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.541169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659e7bb-f1cf-429e-9296-905f9bbb133c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.543884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9556d337cc6b4b2789faf8a1df7e54de'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.544554 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9556d337cc6b4b2789faf8a1df7e54de'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.546076 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.546735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.547017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.547313 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.548004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.549910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.551499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-96c822bc-2d3e-4a08-a0ba-34259861a673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9556d337cc6b4b2789faf8a1df7e54de'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:06.557518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1317/2641] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:06 2022] DELETE /identity/v3/users/9556d337cc6b4b2789faf8a1df7e54de => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:06.562057 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.562353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.562632 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.579900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:06.581130 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:06.638912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1318/2642] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:46:06.649427 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1325/2643] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:06 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:06.649633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.650413 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.650939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:06.652117 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:06.664103 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaccca83-065b-4b8d-9970-c67122cddd79 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.668739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.669394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.669680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.669957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.670683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.672306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.682517 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1326/2644] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:46:06.686229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.697143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95436a5f-dacb-45f4-9425-6746146937df admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.702235 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.702898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.703213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.703494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.704219 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.705812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.711081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cf051-a9ac-484f-b651-77580b0e4cf1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.714790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab8117f-31bb-4c3e-b396-a1fbd69e7581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.715467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8117f-31bb-4c3e-b396-a1fbd69e7581 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.715747 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8117f-31bb-4c3e-b396-a1fbd69e7581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.716019 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab8117f-31bb-4c3e-b396-a1fbd69e7581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.717511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1327/2645] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:46:06.721706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.727705 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8117f-31bb-4c3e-b396-a1fbd69e7581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.729155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab8117f-31bb-4c3e-b396-a1fbd69e7581 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.731785 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62d3b5-2a5b-4bdc-9be7-cd9562f35193 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:06.736630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:06.737494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.737779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.738060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] PATH_INFO: `/v3/projects/1c8ec5d0210746a081edaf4a94b7b187/users/c8cae921e3984e0ab0338798785da0c2/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.738534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1319/2646] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:06.753406 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8ec5d0210746a081edaf4a94b7b187, user_id=c8cae921e3984e0ab0338798785da0c2, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:06.756365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:06.841793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1328/2647] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:06 2022] PUT /identity/v3/projects/1c8ec5d0210746a081edaf4a94b7b187/users/c8cae921e3984e0ab0338798785da0c2/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:06.847084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:06.847401 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:06.847691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:06.866149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:06.867514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:06.929447 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1320/2648] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:06.946399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:06.953260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:07.005519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8def46-1739-44a9-adf5-65f6d8838bc4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:07.009535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:07.010192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:07.010476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:07.010757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:07.020348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:07.022186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:07.032154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1329/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:07.183888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:07.185364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:07.199988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cda9ba-e190-4f68-87fc-d9bbab223ff1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:07.206585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:07.210514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:07.210514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:07.210514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] PATH_INFO: `/v3/projects/accf71ecdabe405582ee44108f73b1b0` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:07.210514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=accf71ecdabe405582ee44108f73b1b0)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:07.211945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:07.346862 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accf71ecdabe405582ee44108f73b1b0', 'request_id': 'req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.353237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accf71ecdabe405582ee44108f73b1b0', 'request_id': 'req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.362222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accf71ecdabe405582ee44108f73b1b0', 'request_id': 'req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.443964 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] The token cache is being invalidate because project accf71ecdabe405582ee44108f73b1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:07.448214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.448214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.448214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1321/2650] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:07 2022] DELETE /identity/v3/projects/accf71ecdabe405582ee44108f73b1b0 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:07.450899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:07.461260 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84e62a-377c-4a3e-9292-39e7f84d6249 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:07.516318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:07.517108 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:07.517393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:07.517671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] PATH_INFO: `/v3/users/5b0df12642ac4a1792b91368c5bbd172` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:07.518847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0df12642ac4a1792b91368c5bbd172)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:07.521421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:07.732092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0df12642ac4a1792b91368c5bbd172'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.738800 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0df12642ac4a1792b91368c5bbd172'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.845105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0df12642ac4a1792b91368c5bbd172'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.858336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0df12642ac4a1792b91368c5bbd172'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.859025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-8ff27f8a-37ca-438c-b83d-957709ff24fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0df12642ac4a1792b91368c5bbd172'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:07.865542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1330/2651] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:07 2022] DELETE /identity/v3/users/5b0df12642ac4a1792b91368c5bbd172 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:08.339438 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:08.342239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:08.361593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3552753-6fa7-4cb4-9dc9-7a1aa0472a1a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:08.420925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:08.421784 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:08.422072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:08.422347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] PATH_INFO: `/v3/projects/2232471cfac04d44b8dc4e41ac100210` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:08.423565 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2232471cfac04d44b8dc4e41ac100210)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:08.425467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:08.549095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2232471cfac04d44b8dc4e41ac100210', 'request_id': 'req-01ba9824-621f-4950-90d8-720ae62033ac'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:08.555214 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2232471cfac04d44b8dc4e41ac100210', 'request_id': 'req-01ba9824-621f-4950-90d8-720ae62033ac'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:08.563038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2232471cfac04d44b8dc4e41ac100210', 'request_id': 'req-01ba9824-621f-4950-90d8-720ae62033ac'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:08.638821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] The token cache is being invalidate because project 2232471cfac04d44b8dc4e41ac100210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:08.639215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:08.644461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-01ba9824-621f-4950-90d8-720ae62033ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:08.644461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1322/2652] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:08 2022] DELETE /identity/v3/projects/2232471cfac04d44b8dc4e41ac100210 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:08.647277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc34c4-2432-49c7-a956-7ce2d9268002 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:08.647791 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc34c4-2432-49c7-a956-7ce2d9268002 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:08.647993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc34c4-2432-49c7-a956-7ce2d9268002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:08.667734 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-3bbc34c4-2432-49c7-a956-7ce2d9268002 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:08.673407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3bbc34c4-2432-49c7-a956-7ce2d9268002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:08.729000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1331/2653] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:08.738101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb876-1bfd-4f86-86b1-f3d89b942d5f None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:08.738393 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb876-1bfd-4f86-86b1-f3d89b942d5f None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:08.738672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb876-1bfd-4f86-86b1-f3d89b942d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:08.761531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-225cb876-1bfd-4f86-86b1-f3d89b942d5f None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:08.770913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-225cb876-1bfd-4f86-86b1-f3d89b942d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:08.774164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1323/2654] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:08.775482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc34c4-2432-49c7-a956-7ce2d9268002 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:08.784977 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc34c4-2432-49c7-a956-7ce2d9268002 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:08.790380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:08.791154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:08.791360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:08.791647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:08.792367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:46:08.792673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:08.794376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:08.810971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1332/2655] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:46:08.812235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cb876-1bfd-4f86-86b1-f3d89b942d5f None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:08.821611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cb876-1bfd-4f86-86b1-f3d89b942d5f None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:08.826692 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:08.827375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:08.827663 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:08.828140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:08.828622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:08.830557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:08.917734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1324/2656] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:08 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:08.921644 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:08.932861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17603d55-99af-459b-8491-d2e788dcbd55 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:08.995295 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:08.996109 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:08.996459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:08.996965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:08.997793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:08.999827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.074304 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1333/2657] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:08 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:09.078385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.089361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bb952-e759-4336-af2d-32130f941fb4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.095028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.096022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.096479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.096773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.097520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.100603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.111472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1325/2658] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:46:09.116075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.130893 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467268a-16d3-4ce4-bb4a-fe1e8978f353 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.137588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0d2a8-0087-40e8-aa45-166a7e42eee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.138332 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d2a8-0087-40e8-aa45-166a7e42eee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.138619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d2a8-0087-40e8-aa45-166a7e42eee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.138901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0d2a8-0087-40e8-aa45-166a7e42eee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.139673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0d2a8-0087-40e8-aa45-166a7e42eee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.141421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0d2a8-0087-40e8-aa45-166a7e42eee1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.170665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1334/2659] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:46:09.180033 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.191697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e705b0-7c2d-48f1-a0d3-524e0fc80a4b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.200473 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.202440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.202927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.203422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] PATH_INFO: `/v3/projects/341f89893b0d4858be8028f3e905153c/users/4f29d7a900df4d628da8f30db7b53b42/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.221257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341f89893b0d4858be8028f3e905153c, user_id=4f29d7a900df4d628da8f30db7b53b42, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.225202 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.332772 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1326/2660] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:09 2022] PUT /identity/v3/projects/341f89893b0d4858be8028f3e905153c/users/4f29d7a900df4d628da8f30db7b53b42/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:09.362362 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8b61-92bb-4591-a306-7ef3bcf3f920 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.362665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8b61-92bb-4591-a306-7ef3bcf3f920 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.363508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d8b61-92bb-4591-a306-7ef3bcf3f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.394322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-1b3d8b61-92bb-4591-a306-7ef3bcf3f920 None None] MFA Rules not processed for user `4f29d7a900df4d628da8f30db7b53b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:09.396601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-1b3d8b61-92bb-4591-a306-7ef3bcf3f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:09.471299 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1335/2661] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:09.476076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.539589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521c94e-46c2-4a7d-8bbf-de2c641c4f13 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.544317 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.544977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.545259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.545536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.546224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.548944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.650653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1327/2662] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:09 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:09.652371 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d8b61-92bb-4591-a306-7ef3bcf3f920 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.663786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d8b61-92bb-4591-a306-7ef3bcf3f920 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.719169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.719857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.720139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.720670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.721368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.723317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.858135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1336/2663] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:09 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:09.862443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.875101 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429ce8-41cc-41a4-a9d2-39ed88236e5a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.880824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.881487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.881771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.882040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.882838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.884714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.902569 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1328/2664] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:09.903705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.915789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a23d3-59c1-45f5-8316-d2a82863a481 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.921935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8823359f-e22f-4f59-b08d-c3943b83dfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.922622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823359f-e22f-4f59-b08d-c3943b83dfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.922923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823359f-e22f-4f59-b08d-c3943b83dfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.923215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823359f-e22f-4f59-b08d-c3943b83dfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.924384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823359f-e22f-4f59-b08d-c3943b83dfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.926004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8823359f-e22f-4f59-b08d-c3943b83dfd4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:09.937115 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1337/2665] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:09.942830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:09.952707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36856da0-5875-4135-a357-f2db85a50899 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:09.957506 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:09.959728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:09.960088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:09.960440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] PATH_INFO: `/v3/projects/3aeff0936acf4fdb8316b4b989e0948a/users/8a70fd5a0d9047679b1990e477103ca1/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:09.978845 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aeff0936acf4fdb8316b4b989e0948a, user_id=8a70fd5a0d9047679b1990e477103ca1, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:09.981710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:10.056777 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1329/2666] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:09 2022] PUT /identity/v3/projects/3aeff0936acf4fdb8316b4b989e0948a/users/8a70fd5a0d9047679b1990e477103ca1/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:10.066909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e734b0-ed75-40d9-a829-6d7fffdc3756 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.068017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e734b0-ed75-40d9-a829-6d7fffdc3756 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.071257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e734b0-ed75-40d9-a829-6d7fffdc3756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.106420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b4e734b0-ed75-40d9-a829-6d7fffdc3756 None None] MFA Rules not processed for user `8a70fd5a0d9047679b1990e477103ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:10.107685 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b4e734b0-ed75-40d9-a829-6d7fffdc3756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:10.177139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1338/2667] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:10.181870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:10.281483 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd4a9-1bb5-4ac7-b983-423fd6965f83 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:10.287609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:10.288307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.288795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.289084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.289803 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:10.291769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:10.401542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1330/2668] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:10 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:10.405506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e734b0-ed75-40d9-a829-6d7fffdc3756 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:10.422015 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e734b0-ed75-40d9-a829-6d7fffdc3756 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:10.483471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:10.484153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.484438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.485275 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.485452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:10.488323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:10.567455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1339/2669] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:10 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:10.569117 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:10.579518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764227-2b63-4737-9208-04f648c90b9e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:10.584638 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:10.585435 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.585732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.586013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.586759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:10.588425 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:10.615623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1331/2670] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:10.619869 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:10.630463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc3578-815a-4a45-8389-e1481f58a962 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:10.635480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:10.636365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.636650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.636929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] PATH_INFO: `/v3/projects/ed8167c4baa845eebffea1fefdc9efcc/users/fc5c307acb4f496c9063fe3723d0b0d4/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.656605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8167c4baa845eebffea1fefdc9efcc, user_id=fc5c307acb4f496c9063fe3723d0b0d4, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:10.659447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:10.753834 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1340/2671] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:10 2022] PUT /identity/v3/projects/ed8167c4baa845eebffea1fefdc9efcc/users/fc5c307acb4f496c9063fe3723d0b0d4/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:10.755519 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:10.765846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fca40c-9f4d-4560-b8ce-b0a3850af737 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:10.830161 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76a2767-6141-4cd0-8a36-6d9907730b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:10.830846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a2767-6141-4cd0-8a36-6d9907730b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.831155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a2767-6141-4cd0-8a36-6d9907730b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.831443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a2767-6141-4cd0-8a36-6d9907730b24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.832186 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a2767-6141-4cd0-8a36-6d9907730b24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:10.833844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76a2767-6141-4cd0-8a36-6d9907730b24 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:10.847399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1332/2672] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:10.849267 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:10.859928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee6e39b-17af-423d-af91-fbd9234aee9f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:10.865300 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:10.866191 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.866482 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.866763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] PATH_INFO: `/v3/projects/ed8167c4baa845eebffea1fefdc9efcc/users/fc5c307acb4f496c9063fe3723d0b0d4/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.868836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed8167c4baa845eebffea1fefdc9efcc, user_id=fc5c307acb4f496c9063fe3723d0b0d4, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:10.871533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:10.883849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1341/2673] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:10 2022] PUT /identity/v3/projects/ed8167c4baa845eebffea1fefdc9efcc/users/fc5c307acb4f496c9063fe3723d0b0d4/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:10.894892 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:10.895240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:10.896107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:10.927421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] MFA Rules not processed for user `fc5c307acb4f496c9063fe3723d0b0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:10.928765 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:11.010767 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1333/2674] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:11.024429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:11.027591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:11.089508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615368b1-0656-48bc-93c1-d98bf691d567 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:11.093205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b5c33-70de-4adb-810e-871a54c20c4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:11.094282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5c33-70de-4adb-810e-871a54c20c4f service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:11.094282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5c33-70de-4adb-810e-871a54c20c4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:11.094519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b5c33-70de-4adb-810e-871a54c20c4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:11.108010 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b5c33-70de-4adb-810e-871a54c20c4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:11.109966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b5c33-70de-4adb-810e-871a54c20c4f service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:11.121589 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1342/2675] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:11.230637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:11.232180 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:11.245920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056998a-3932-430d-9683-faf6797f15e1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:11.249863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:11.250591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:11.250971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:11.251414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:11.341155 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:11.342965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:11.358470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1334/2676] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:12.850233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b093-c3ca-45c6-8950-be13976e21a4 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:12.850233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b093-c3ca-45c6-8950-be13976e21a4 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:12.850233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c9b093-c3ca-45c6-8950-be13976e21a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:12.878416 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-74c9b093-c3ca-45c6-8950-be13976e21a4 None None] MFA Rules not processed for user `c8cae921e3984e0ab0338798785da0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:12.880710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-74c9b093-c3ca-45c6-8950-be13976e21a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:12.954820 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1343/2677] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:12.959973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:12.961508 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:13.026515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b7631-d5d1-411b-b7b6-2e6512cd91c5 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:13.031010 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:13.031795 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:13.032078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:13.032354 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:13.033037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:13.034923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:13.132538 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1335/2678] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:12 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:13.136563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9b093-c3ca-45c6-8950-be13976e21a4 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:13.147559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c9b093-c3ca-45c6-8950-be13976e21a4 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:13.202458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:13.203140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:13.203444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:13.203722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:13.204460 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:13.206378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:13.280135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1344/2679] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:13 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:13.284373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:13.302685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb197-b660-4ee1-8e04-8eb646f0cab4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:13.308983 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:13.309686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:13.310154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:13.310597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:13.311937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:13.313654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:13.328041 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1336/2680] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:13.331860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:13.342417 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58652e-62f0-4980-8d1c-398601c355bc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:13.348095 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:13.350390 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:13.350990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:13.351307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] PATH_INFO: `/v3/projects/2347a8541a00405eaea02352044f9b78/users/6c0442ee9a1b4285a11b0e2d3994335c/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:13.382736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2347a8541a00405eaea02352044f9b78, user_id=6c0442ee9a1b4285a11b0e2d3994335c, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:13.385494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:13.469167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1345/2681] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:13 2022] PUT /identity/v3/projects/2347a8541a00405eaea02352044f9b78/users/6c0442ee9a1b4285a11b0e2d3994335c/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:13.473153 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:13.485808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2ce806-0be0-4e16-82b7-74b32f058f31 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:13.563931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:13.564603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:13.564891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:13.565171 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:13.565904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:13.568083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:13.581316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1337/2682] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:13.582380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:13.594092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d4986-880d-4fbe-ba56-41170c7d068c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:13.599691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb3dc1-4112-42fc-b42e-ce2d98828281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:13.600592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb3dc1-4112-42fc-b42e-ce2d98828281 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:13.600877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb3dc1-4112-42fc-b42e-ce2d98828281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:13.601162 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb3dc1-4112-42fc-b42e-ce2d98828281 admin admin] PATH_INFO: `/v3/projects/2347a8541a00405eaea02352044f9b78/users/6c0442ee9a1b4285a11b0e2d3994335c/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:13.603215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb3dc1-4112-42fc-b42e-ce2d98828281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2347a8541a00405eaea02352044f9b78, user_id=6c0442ee9a1b4285a11b0e2d3994335c, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:13.607609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb3dc1-4112-42fc-b42e-ce2d98828281 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:13.617923 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1346/2683] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:13 2022] PUT /identity/v3/projects/2347a8541a00405eaea02352044f9b78/users/6c0442ee9a1b4285a11b0e2d3994335c/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:15.515531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:15.529091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47ab3-0661-476e-a558-731b66aded42 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:15.608691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:15.609727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:15.610492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:15.610492 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] PATH_INFO: `/v3/users/4f29d7a900df4d628da8f30db7b53b42` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:15.611838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f29d7a900df4d628da8f30db7b53b42)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:15.614695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:15.850971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f29d7a900df4d628da8f30db7b53b42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:15.908069 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f29d7a900df4d628da8f30db7b53b42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:15.931819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f29d7a900df4d628da8f30db7b53b42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:15.938488 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f29d7a900df4d628da8f30db7b53b42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:15.947622 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f29d7a900df4d628da8f30db7b53b42'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:15.957268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1338/2684] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:15 2022] DELETE /identity/v3/users/4f29d7a900df4d628da8f30db7b53b42 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:15.958885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:15.959446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:15.959797 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:15.980512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:15.982697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:16.062153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1347/2685] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:46:16.073242 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:16.076177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:16.144723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c619-7ac4-4d9b-be9d-a41c1750ccc2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:16.148461 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:16.149846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:16.149846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:16.149846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:16.163585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:16.165098 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:16.177249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1339/2686] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:16.865467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:16.866925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:16.891825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02194cbb-2117-4407-8b6c-a41ed32e2d60 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:16.900197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:16.901213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:16.901508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:16.901875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] PATH_INFO: `/v3/projects/341f89893b0d4858be8028f3e905153c` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:16.903049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=341f89893b0d4858be8028f3e905153c)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:16.905023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:17.034187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341f89893b0d4858be8028f3e905153c', 'request_id': 'req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.090288 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341f89893b0d4858be8028f3e905153c', 'request_id': 'req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.099477 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341f89893b0d4858be8028f3e905153c', 'request_id': 'req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.111903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] The token cache is being invalidate because project 341f89893b0d4858be8028f3e905153c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:17.112197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.112934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.117521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1348/2687] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:16 2022] DELETE /identity/v3/projects/341f89893b0d4858be8028f3e905153c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:17.118824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:17.129403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbada73c-0d9f-4ed3-900d-8b0f16ea5cea service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:17.187992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:17.188865 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:17.189371 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:17.189651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] PATH_INFO: `/v3/users/8a70fd5a0d9047679b1990e477103ca1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:17.190863 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a70fd5a0d9047679b1990e477103ca1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:17.193542 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:17.341971 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a70fd5a0d9047679b1990e477103ca1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.421832 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a70fd5a0d9047679b1990e477103ca1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.438485 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a70fd5a0d9047679b1990e477103ca1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.439977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a70fd5a0d9047679b1990e477103ca1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.451263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a70fd5a0d9047679b1990e477103ca1'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:17.461196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1340/2688] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:17 2022] DELETE /identity/v3/users/8a70fd5a0d9047679b1990e477103ca1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:17.983787 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:17.986340 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:18.033272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a40e7-8f23-4ca9-8ac0-ed670e144ad1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:18.114281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:18.115081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:18.115721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:18.116014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] PATH_INFO: `/v3/projects/3aeff0936acf4fdb8316b4b989e0948a` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:18.117289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aeff0936acf4fdb8316b4b989e0948a)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:18.119554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:18.238218 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aeff0936acf4fdb8316b4b989e0948a', 'request_id': 'req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.336650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aeff0936acf4fdb8316b4b989e0948a', 'request_id': 'req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.344195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aeff0936acf4fdb8316b4b989e0948a', 'request_id': 'req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.373858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] The token cache is being invalidate because project 3aeff0936acf4fdb8316b4b989e0948a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:18.374132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.374782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.376458 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1349/2689] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:17 2022] DELETE /identity/v3/projects/3aeff0936acf4fdb8316b4b989e0948a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:18.380499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:18.381973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:18.396028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdc6b8-a976-4f46-a2c9-4a1fba0a5d6a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:18.453380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:18.454321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:18.454546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:18.454819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] PATH_INFO: `/v3/users/fc5c307acb4f496c9063fe3723d0b0d4` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:18.456074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc5c307acb4f496c9063fe3723d0b0d4)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:18.458608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:18.672340 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc5c307acb4f496c9063fe3723d0b0d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.794576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc5c307acb4f496c9063fe3723d0b0d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.815517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc5c307acb4f496c9063fe3723d0b0d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.816531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc5c307acb4f496c9063fe3723d0b0d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.826136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79290d11-72cb-44e9-a370-77d38d97fd4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc5c307acb4f496c9063fe3723d0b0d4'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:18.837166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1341/2690] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:18 2022] DELETE /identity/v3/users/fc5c307acb4f496c9063fe3723d0b0d4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:19.247988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:19.249634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:19.266747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1cc2a-25a0-4b07-96f6-ab6dda258556 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:19.408976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:19.410059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:19.410437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:19.411933 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] PATH_INFO: `/v3/projects/ed8167c4baa845eebffea1fefdc9efcc` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:19.415581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed8167c4baa845eebffea1fefdc9efcc)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:19.417789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:19.599634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed8167c4baa845eebffea1fefdc9efcc', 'request_id': 'req-a8d0b464-7d38-4033-b794-096b3f2e8302'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:19.632085 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:19.632603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:19.632913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:19.663033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed8167c4baa845eebffea1fefdc9efcc', 'request_id': 'req-a8d0b464-7d38-4033-b794-096b3f2e8302'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:19.665719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] MFA Rules not processed for user `6c0442ee9a1b4285a11b0e2d3994335c`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:19.669633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:19.670824 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed8167c4baa845eebffea1fefdc9efcc', 'request_id': 'req-a8d0b464-7d38-4033-b794-096b3f2e8302'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:19.684279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] The token cache is being invalidate because project ed8167c4baa845eebffea1fefdc9efcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:19.684546 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:19.685176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-a8d0b464-7d38-4033-b794-096b3f2e8302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:19.686747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1350/2691] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:19 2022] DELETE /identity/v3/projects/ed8167c4baa845eebffea1fefdc9efcc => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:19.692778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ad08-fb69-447a-bcc8-79f94b2ab347 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:19.693311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ad08-fb69-447a-bcc8-79f94b2ab347 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:19.693582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8ad08-fb69-447a-bcc8-79f94b2ab347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:19.717858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b6a8ad08-fb69-447a-bcc8-79f94b2ab347 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:19.719702 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b6a8ad08-fb69-447a-bcc8-79f94b2ab347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:19.772641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1342/2692] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:19.786943 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:19.791748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:19.805512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1351/2693] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:46:19.813756 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779cbb9-c84a-4fbd-9588-9b3b94a06b9b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:19.814043 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779cbb9-c84a-4fbd-9588-9b3b94a06b9b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:19.814323 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779cbb9-c84a-4fbd-9588-9b3b94a06b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:19.835553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e779cbb9-c84a-4fbd-9588-9b3b94a06b9b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:19.837041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e779cbb9-c84a-4fbd-9588-9b3b94a06b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:19.846678 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1352/2694] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:19.850821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779cbb9-c84a-4fbd-9588-9b3b94a06b9b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:19.862601 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779cbb9-c84a-4fbd-9588-9b3b94a06b9b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:19.868207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:19.868812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:19.869232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:19.869518 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:19.870268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:46:19.870574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:19.872226 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:19.879544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1392e1b-cc17-4439-8c30-750c72b047fc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:19.887195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1353/2695] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:46:19.890325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f37dda98124a8c8cf4406d985933f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:19.891456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:19.891650 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:19.892111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:19.892515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:19.895082 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:19.904594 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926200-10a5-4d8d-bfed-4a2c98504e2a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:19.914368 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059cac8-f231-4e2d-95ef-8ed35849dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:19.925536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059cac8-f231-4e2d-95ef-8ed35849dab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:19.925996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059cac8-f231-4e2d-95ef-8ed35849dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:19.926336 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059cac8-f231-4e2d-95ef-8ed35849dab3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:19.928366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059cac8-f231-4e2d-95ef-8ed35849dab3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:19.930350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059cac8-f231-4e2d-95ef-8ed35849dab3 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:19.968805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:19.970352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:19.981706 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1343/2696] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:46:20.027193 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1354/2697] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:19 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:20.029787 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.043458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849c3cb-29b8-4408-bd5e-1a039c997685 service glance] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.107176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.107859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.108146 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.108444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.109142 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.111051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.194372 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.201861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.201861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.202091 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1344/2698] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:20 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:20.203633 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.213489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a44e5-28a8-47c5-95f3-a95eaf854f06 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.214217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:20.215505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:20.218328 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.219037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.219311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.219919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.220916 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.222536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.234143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1345/2699] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:46:20.237876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.248648 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce350aa6-e1b0-4e84-832a-965a66c9fc0b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.253372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.254020 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.254303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.254617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.257184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.257184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.267837 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1346/2700] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:46:20.271898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.281277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd719c8b-aa65-4edf-a152-9d0fdaf3b6a6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.281786 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1355/2701] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:46:20.286906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcb7a8-0eb6-48ea-bda5-d94454e25138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.287858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb7a8-0eb6-48ea-bda5-d94454e25138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.288185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb7a8-0eb6-48ea-bda5-d94454e25138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.288457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcb7a8-0eb6-48ea-bda5-d94454e25138 admin admin] PATH_INFO: `/v3/projects/77bbf9ea5aa5416c810b1a12d586127d/users/57898a86a0c74c22a40e4684febc5792/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.294446 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.295839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:20.305232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcb7a8-0eb6-48ea-bda5-d94454e25138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bbf9ea5aa5416c810b1a12d586127d, user_id=57898a86a0c74c22a40e4684febc5792, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.307925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcb7a8-0eb6-48ea-bda5-d94454e25138 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.365055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feefee19-73d1-4e73-97e0-faf0380a4629 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.370072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1347/2702] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:20 2022] PUT /identity/v3/projects/77bbf9ea5aa5416c810b1a12d586127d/users/57898a86a0c74c22a40e4684febc5792/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:20.381287 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621912e8-881d-4ff3-b0da-f963d2a3042c None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.382032 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621912e8-881d-4ff3-b0da-f963d2a3042c None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.382318 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621912e8-881d-4ff3-b0da-f963d2a3042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.408398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-621912e8-881d-4ff3-b0da-f963d2a3042c None None] MFA Rules not processed for user `57898a86a0c74c22a40e4684febc5792`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:20.409612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-621912e8-881d-4ff3-b0da-f963d2a3042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:20.425634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.426295 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.426588 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.426863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.478867 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1348/2703] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:20.483163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621912e8-881d-4ff3-b0da-f963d2a3042c None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.488160 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.490293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.498768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1356/2704] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:46:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 10 21:46:20.550074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621912e8-881d-4ff3-b0da-f963d2a3042c None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.555408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.556078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.556364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.556641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.557345 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.559306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.695048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1349/2705] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:20 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:20.696057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.709743 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50914bb4-487e-4d53-a0c9-4f00266cbad8 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.783513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.784207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.784493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.784776 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.785480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.788000 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.889040 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1357/2706] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:20 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:20.900691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.914215 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3cc296-e99a-4c12-8058-c0318f6581f3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.919441 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.920251 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.920631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.921002 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.922034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.924014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:20.942721 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1350/2707] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:20.944026 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:20.957821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4a970-e4dd-4008-9e1c-cb434aca48f2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:20.963442 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:20.964463 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:20.964935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:20.965283 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] PATH_INFO: `/v3/projects/52ecc379b149484a91cbbc268df6f319/users/81ce8f50f0b54224867d4b040f36c354/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:20.986564 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ecc379b149484a91cbbc268df6f319, user_id=81ce8f50f0b54224867d4b040f36c354, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:20.993385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:21.078382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1358/2708] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:20 2022] PUT /identity/v3/projects/52ecc379b149484a91cbbc268df6f319/users/81ce8f50f0b54224867d4b040f36c354/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:21.080183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:21.097603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2783e-a273-411d-89e5-c7f49438cddf admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:21.170543 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aede55c-2c4e-4436-b18d-5611cfdb2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:21.171044 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede55c-2c4e-4436-b18d-5611cfdb2e6a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:21.171459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede55c-2c4e-4436-b18d-5611cfdb2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:21.173582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aede55c-2c4e-4436-b18d-5611cfdb2e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:21.174609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aede55c-2c4e-4436-b18d-5611cfdb2e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:21.177074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aede55c-2c4e-4436-b18d-5611cfdb2e6a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:21.190925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1351/2709] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:21.192378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:21.209637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a2c84-d238-41d6-8a42-2c6f2810bcbb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:21.214850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:21.218680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:21.219048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:21.219422 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] PATH_INFO: `/v3/projects/52ecc379b149484a91cbbc268df6f319/users/81ce8f50f0b54224867d4b040f36c354/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:21.222019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ecc379b149484a91cbbc268df6f319, user_id=81ce8f50f0b54224867d4b040f36c354, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:21.226084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:21.240526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1359/2710] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:21 2022] PUT /identity/v3/projects/52ecc379b149484a91cbbc268df6f319/users/81ce8f50f0b54224867d4b040f36c354/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:21.252138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b543-54cf-46a3-82d8-187e56f5b84a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:21.252503 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b543-54cf-46a3-82d8-187e56f5b84a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:21.252855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b543-54cf-46a3-82d8-187e56f5b84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:21.292038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-bb87b543-54cf-46a3-82d8-187e56f5b84a None None] MFA Rules not processed for user `81ce8f50f0b54224867d4b040f36c354`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:21.293255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-bb87b543-54cf-46a3-82d8-187e56f5b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:21.428199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1352/2711] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:21.440766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:21.443349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:21.514669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768c2de-d589-474e-b943-c47812c634ca admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:21.522272 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:21.523347 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:21.525908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:21.526488 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:21.537528 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:21.539059 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:21.560155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1360/2712] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:21.780576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b543-54cf-46a3-82d8-187e56f5b84a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:21.792920 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b543-54cf-46a3-82d8-187e56f5b84a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:21.799105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8aed24-8e1e-4945-a1e4-f127a391e66f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:21.800137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aed24-8e1e-4945-a1e4-f127a391e66f service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:21.800436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aed24-8e1e-4945-a1e4-f127a391e66f service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:21.800702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aed24-8e1e-4945-a1e4-f127a391e66f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:21.906577 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8aed24-8e1e-4945-a1e4-f127a391e66f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:21.908096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8aed24-8e1e-4945-a1e4-f127a391e66f service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:21.927674 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1353/2713] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:46:29.933492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:30.004099 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c641b-ac0d-42ed-92c5-97247e5c3ba6 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:30.009597 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:30.010676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:30.011213 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:30.011653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] PATH_INFO: `/v3/users/57898a86a0c74c22a40e4684febc5792` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:30.013054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57898a86a0c74c22a40e4684febc5792)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:30.015312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:30.198082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57898a86a0c74c22a40e4684febc5792'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:30.206425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57898a86a0c74c22a40e4684febc5792'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:30.273889 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57898a86a0c74c22a40e4684febc5792'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:30.287023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57898a86a0c74c22a40e4684febc5792'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:30.287988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57898a86a0c74c22a40e4684febc5792'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:30.294250 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1361/2714] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:29 2022] DELETE /identity/v3/users/57898a86a0c74c22a40e4684febc5792 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:30.298811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:30.299382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:30.299382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:30.318653 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:30.320223 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:30.395321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1354/2715] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:30.407547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:30.409321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:30.469884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a8639-750e-484f-89e8-b3f4b3c7b2e7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:30.473737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2739f3-3d6d-4a5e-b602-c7629ed3af93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:30.474385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2739f3-3d6d-4a5e-b602-c7629ed3af93 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:30.474665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2739f3-3d6d-4a5e-b602-c7629ed3af93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:30.474941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2739f3-3d6d-4a5e-b602-c7629ed3af93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:30.485153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2739f3-3d6d-4a5e-b602-c7629ed3af93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:30.486591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2739f3-3d6d-4a5e-b602-c7629ed3af93 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:30.497423 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1362/2716] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 10 21:46:30.925499 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:30.926914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:30.942914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e2ad4-76c9-4c78-95c5-48c05696ec92 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:30.955679 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:30.956598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:30.956878 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:30.957152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] PATH_INFO: `/v3/projects/77bbf9ea5aa5416c810b1a12d586127d` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:30.958407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bbf9ea5aa5416c810b1a12d586127d)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:30.960583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:30.985153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790b70-1387-4591-94f6-130b9704ded5 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:30.985716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790b70-1387-4591-94f6-130b9704ded5 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:30.985716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790b70-1387-4591-94f6-130b9704ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:31.003767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-25790b70-1387-4591-94f6-130b9704ded5 None None] MFA Rules not processed for user `c8cae921e3984e0ab0338798785da0c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:31.004950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-25790b70-1387-4591-94f6-130b9704ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:31.056423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bbf9ea5aa5416c810b1a12d586127d', 'request_id': 'req-7883a17b-25eb-46d3-9622-8764f47dd82c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.061848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bbf9ea5aa5416c810b1a12d586127d', 'request_id': 'req-7883a17b-25eb-46d3-9622-8764f47dd82c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.068088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bbf9ea5aa5416c810b1a12d586127d', 'request_id': 'req-7883a17b-25eb-46d3-9622-8764f47dd82c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.072836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1363/2717] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:46:31.128968 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] The token cache is being invalidate because project 77bbf9ea5aa5416c810b1a12d586127d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:31.129263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.129992 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.132316 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1355/2718] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:30 2022] DELETE /identity/v3/projects/77bbf9ea5aa5416c810b1a12d586127d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:31.136799 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790b70-1387-4591-94f6-130b9704ded5 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:31.147901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790b70-1387-4591-94f6-130b9704ded5 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:31.204253 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:31.205167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:31.205457 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:31.205736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] PATH_INFO: `/v3/users/81ce8f50f0b54224867d4b040f36c354` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:31.207049 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ce8f50f0b54224867d4b040f36c354)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:31.209017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:31.379316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ce8f50f0b54224867d4b040f36c354'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.386469 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ce8f50f0b54224867d4b040f36c354'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.468183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ce8f50f0b54224867d4b040f36c354'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.481187 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ce8f50f0b54224867d4b040f36c354'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.483232 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3a6a9f5-df37-4f4e-a4a8-7a594d52ff60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ce8f50f0b54224867d4b040f36c354'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:31.489658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1364/2719] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:31 2022] DELETE /identity/v3/users/81ce8f50f0b54224867d4b040f36c354 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:31.943735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:31.946403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:31.958872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883a17b-25eb-46d3-9622-8764f47dd82c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:32.018643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:32.019646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.019868 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.020144 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] PATH_INFO: `/v3/projects/52ecc379b149484a91cbbc268df6f319` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.021338 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ecc379b149484a91cbbc268df6f319)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:32.024105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:32.130035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ecc379b149484a91cbbc268df6f319', 'request_id': 'req-75dba36f-c615-4b61-a837-3b5f84f05ad6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:32.136184 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ecc379b149484a91cbbc268df6f319', 'request_id': 'req-75dba36f-c615-4b61-a837-3b5f84f05ad6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:32.142181 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ecc379b149484a91cbbc268df6f319', 'request_id': 'req-75dba36f-c615-4b61-a837-3b5f84f05ad6'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:32.216457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] The token cache is being invalidate because project 52ecc379b149484a91cbbc268df6f319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:32.216773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:32.217398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-75dba36f-c615-4b61-a837-3b5f84f05ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:32.218954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1356/2720] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:31 2022] DELETE /identity/v3/projects/52ecc379b149484a91cbbc268df6f319 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:32.224391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7c0ca-9589-4cf1-a28f-60e1532317b7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.224884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7c0ca-9589-4cf1-a28f-60e1532317b7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.225006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7c0ca-9589-4cf1-a28f-60e1532317b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.243322 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e3e7c0ca-9589-4cf1-a28f-60e1532317b7 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:32.244534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e3e7c0ca-9589-4cf1-a28f-60e1532317b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:32.312809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1365/2721] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:32.321193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988465-2d21-4dee-84d3-0e6525735e82 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.321487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988465-2d21-4dee-84d3-0e6525735e82 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.321769 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93988465-2d21-4dee-84d3-0e6525735e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.343999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-93988465-2d21-4dee-84d3-0e6525735e82 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:32.345307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-93988465-2d21-4dee-84d3-0e6525735e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:32.358792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1357/2722] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:32.363088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7c0ca-9589-4cf1-a28f-60e1532317b7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:32.374879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7c0ca-9589-4cf1-a28f-60e1532317b7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:32.381247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:32.382540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.382819 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.383093 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.383860 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:46:32.384215 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:32.385790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:32.397809 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1366/2723] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:46:32.402464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93988465-2d21-4dee-84d3-0e6525735e82 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:32.411572 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93988465-2d21-4dee-84d3-0e6525735e82 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:32.416444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:32.417092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.417854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.417854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.418381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:32.420307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:32.519284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1358/2724] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:32 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:32.528165 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:32.538130 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d1c78-c770-4fd6-8f1f-0b0336950023 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:32.593606 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:32.594270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.594553 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.594827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.595550 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:32.597750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:32.663208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1367/2725] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:32 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:32.667140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:32.677430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65567242-860c-4a3d-9930-8a5c5a13928c admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:32.682759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:32.683493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.683782 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.684060 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.684792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:32.686436 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:32.697598 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1359/2726] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:32.701680 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:32.713361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77b6a9-4e60-46c6-8433-f9f6e1dd0f68 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:32.717972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4fc69-a8ba-4af6-8287-0e3ba7d3a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:32.718635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fc69-a8ba-4af6-8287-0e3ba7d3a05a admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.718898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fc69-a8ba-4af6-8287-0e3ba7d3a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.719201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4fc69-a8ba-4af6-8287-0e3ba7d3a05a admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.719924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4fc69-a8ba-4af6-8287-0e3ba7d3a05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:32.721775 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4fc69-a8ba-4af6-8287-0e3ba7d3a05a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:32.732324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1368/2727] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:32.736811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:32.747611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58b69-638e-4cc5-8656-c0b2a61ad5ed admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:32.752677 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:32.753559 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.753870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.754151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] PATH_INFO: `/v3/projects/808ba63a627a491ea147b3bb969c81a7/users/60a081f67852443198d8dffead709213/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.768698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808ba63a627a491ea147b3bb969c81a7, user_id=60a081f67852443198d8dffead709213, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:32.771430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:32.874806 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1360/2728] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:32 2022] PUT /identity/v3/projects/808ba63a627a491ea147b3bb969c81a7/users/60a081f67852443198d8dffead709213/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:32.880541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3367-1d09-44ae-bfef-461167d3a747 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:32.880836 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3367-1d09-44ae-bfef-461167d3a747 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:32.881141 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df3367-1d09-44ae-bfef-461167d3a747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:32.900662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-a0df3367-1d09-44ae-bfef-461167d3a747 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:32.901999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a0df3367-1d09-44ae-bfef-461167d3a747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:32.960997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1369/2729] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:32.970484 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:32.972585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:33.031100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb08e-58a2-4dc9-a601-d72f4b335ef6 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:33.034778 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:33.035456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:33.035739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:33.036015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:33.045558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:33.047791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:33.056895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1361/2730] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:34.275844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d479-5906-43a8-9c8a-a78d553ed057 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:34.276326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d479-5906-43a8-9c8a-a78d553ed057 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:34.276448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d479-5906-43a8-9c8a-a78d553ed057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:34.294901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-70d2d479-5906-43a8-9c8a-a78d553ed057 None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:34.296170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-70d2d479-5906-43a8-9c8a-a78d553ed057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:34.352437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1370/2731] 10.222.0.49 () {58 vars in 1009 bytes} [Tue May 10 21:46:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:34.367052 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:34.367950 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:34.439336 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84b2d6-661f-4790-a89e-19a58613c88a service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:34.445074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:34.445727 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:34.446013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:34.446322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:34.454545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:34.456151 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:34.464662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1362/2732] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:46:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:46:34.750781 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca5770-0d2d-4d9f-ada4-e55c576834cc None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:34.751405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca5770-0d2d-4d9f-ada4-e55c576834cc None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:34.751904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca5770-0d2d-4d9f-ada4-e55c576834cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:34.816337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-23ca5770-0d2d-4d9f-ada4-e55c576834cc None None] MFA Rules not processed for user `60a081f67852443198d8dffead709213`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:34.817932 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-23ca5770-0d2d-4d9f-ada4-e55c576834cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:34.949669 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1371/2733] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:34.950269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:34.987752 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e17f8a0-a084-4609-b64f-4f5e001bafaa service swift] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:34.995877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:34.997428 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:34.998856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:34.998856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:34.999201 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:35.001504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:35.113909 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca5770-0d2d-4d9f-ada4-e55c576834cc None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:35.120253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1363/2734] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:34 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:35.125641 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca5770-0d2d-4d9f-ada4-e55c576834cc None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:35.194911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:35.195940 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:35.196538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:35.197237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:35.198205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:35.201047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:35.356492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1372/2735] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:35 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:46:35.360589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:35.373143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bb1ed-2691-4013-97f7-c0d7f64d6998 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:35.391789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:35.392457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:35.392744 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:35.393013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:35.394005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:35.395828 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:35.411789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1364/2736] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:35.416063 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:35.433999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8a648-cd15-4d73-872e-d75ec4429952 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:35.439031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:35.440143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:35.440675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:35.441102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] PATH_INFO: `/v3/projects/0d51ab494da9405f9c4a1a6db44e83da/users/2d3549932b6f415b81e71d62666ffdb2/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:35.476559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d51ab494da9405f9c4a1a6db44e83da, user_id=2d3549932b6f415b81e71d62666ffdb2, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:35.479808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:35.616385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1373/2737] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:35 2022] PUT /identity/v3/projects/0d51ab494da9405f9c4a1a6db44e83da/users/2d3549932b6f415b81e71d62666ffdb2/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:35.617743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:35.629123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2c0e3-718b-4202-96c1-a84788cfd72a admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:35.733668 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee9e34-f0f4-4ecd-921b-378b4ced5679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:35.734404 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee9e34-f0f4-4ecd-921b-378b4ced5679 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:35.734913 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee9e34-f0f4-4ecd-921b-378b4ced5679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:35.735326 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee9e34-f0f4-4ecd-921b-378b4ced5679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:35.736163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee9e34-f0f4-4ecd-921b-378b4ced5679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:35.737859 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee9e34-f0f4-4ecd-921b-378b4ced5679 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:35.750475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1365/2738] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:35.754333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:35.766183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e51424-0f43-4af2-aebb-4a366ba99349 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:35.770988 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:35.772017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:35.772721 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:35.773092 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] PATH_INFO: `/v3/projects/0d51ab494da9405f9c4a1a6db44e83da/users/2d3549932b6f415b81e71d62666ffdb2/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:35.775233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d51ab494da9405f9c4a1a6db44e83da, user_id=2d3549932b6f415b81e71d62666ffdb2, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:35.778127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:35.789677 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1374/2739] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:35 2022] PUT /identity/v3/projects/0d51ab494da9405f9c4a1a6db44e83da/users/2d3549932b6f415b81e71d62666ffdb2/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:46:37.593735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187a9e2-3c6c-446e-82e3-a47d42146a67 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:37.594402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187a9e2-3c6c-446e-82e3-a47d42146a67 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:37.594402 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187a9e2-3c6c-446e-82e3-a47d42146a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:37.638412 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-6187a9e2-3c6c-446e-82e3-a47d42146a67 None None] MFA Rules not processed for user `2d3549932b6f415b81e71d62666ffdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:37.640140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6187a9e2-3c6c-446e-82e3-a47d42146a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:37.712391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1366/2740] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:37.725278 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:37.728486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:37.829421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c853b60-a829-4ff7-8960-31ea733ddbcc admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:37.843399 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:37.844197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:37.844534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:37.844922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:37.937554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:37.939089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:37.951154 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1375/2741] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:39.751395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187a9e2-3c6c-446e-82e3-a47d42146a67 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:39.761179 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187a9e2-3c6c-446e-82e3-a47d42146a67 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:39.764812 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:39.765398 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:39.765927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:39.766408 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:39.777037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:39.778851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:39.790616 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1367/2742] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:39 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:41.973789 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:41.982464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb28c6-3fc7-4d1a-a24b-f4683be69d5c service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:41.986857 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:41.987041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:41.987308 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:41.987593 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:41.989386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:42.072393 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:42.073877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:42.084412 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1376/2743] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:46:55.278852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:55.346422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2d6ac-1294-41dc-9419-f55af719587e service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:55.351259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:55.352136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:55.352424 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:55.352704 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] PATH_INFO: `/v3/users/60a081f67852443198d8dffead709213` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:55.353904 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a081f67852443198d8dffead709213)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:55.355872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:55.516107 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a081f67852443198d8dffead709213'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:55.605407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a081f67852443198d8dffead709213'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:55.617933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a081f67852443198d8dffead709213'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:55.618576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a081f67852443198d8dffead709213'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:55.625152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a081f67852443198d8dffead709213'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:55.630827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1368/2744] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:55 2022] DELETE /identity/v3/users/60a081f67852443198d8dffead709213 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:55.875907 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:55.887763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aeab32-9399-4780-aa41-93ac36d3811a service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:55.943184 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:55.944064 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:55.944346 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:55.945280 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] PATH_INFO: `/v3/projects/808ba63a627a491ea147b3bb969c81a7` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:55.946466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808ba63a627a491ea147b3bb969c81a7)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:55.948421 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:56.074673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808ba63a627a491ea147b3bb969c81a7', 'request_id': 'req-5df8a876-42ef-480e-a2ae-27b528747e58'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.145920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808ba63a627a491ea147b3bb969c81a7', 'request_id': 'req-5df8a876-42ef-480e-a2ae-27b528747e58'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.151651 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808ba63a627a491ea147b3bb969c81a7', 'request_id': 'req-5df8a876-42ef-480e-a2ae-27b528747e58'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.162675 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] The token cache is being invalidate because project 808ba63a627a491ea147b3bb969c81a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:56.162962 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.164209 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.165730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1377/2745] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:55 2022] DELETE /identity/v3/projects/808ba63a627a491ea147b3bb969c81a7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:56.169719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:56.171193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:56.184734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c1db2f-0df9-493a-b51d-b6b99841790f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:56.239301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:56.240288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:56.240657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:56.240931 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] PATH_INFO: `/v3/users/2d3549932b6f415b81e71d62666ffdb2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:56.242875 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d3549932b6f415b81e71d62666ffdb2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:56.244872 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:56.455047 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d3549932b6f415b81e71d62666ffdb2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.525134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d3549932b6f415b81e71d62666ffdb2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.536824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d3549932b6f415b81e71d62666ffdb2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.537471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d3549932b6f415b81e71d62666ffdb2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.545172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-289b9817-1d53-42d8-8c84-3662d7b535ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d3549932b6f415b81e71d62666ffdb2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:56.551024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1369/2746] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:46:56 2022] DELETE /identity/v3/users/2d3549932b6f415b81e71d62666ffdb2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:56.812189 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:56.814531 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:56.832882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8a876-42ef-480e-a2ae-27b528747e58 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:56.892185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:56.893037 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:56.893316 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:56.893587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] PATH_INFO: `/v3/projects/0d51ab494da9405f9c4a1a6db44e83da` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:56.894749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d51ab494da9405f9c4a1a6db44e83da)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:56.896676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:56.993337 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d51ab494da9405f9c4a1a6db44e83da', 'request_id': 'req-1bff463c-55b5-4e01-a6dc-b514f0f0480c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:57.062127 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d51ab494da9405f9c4a1a6db44e83da', 'request_id': 'req-1bff463c-55b5-4e01-a6dc-b514f0f0480c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:57.067706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d51ab494da9405f9c4a1a6db44e83da', 'request_id': 'req-1bff463c-55b5-4e01-a6dc-b514f0f0480c'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:57.079225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] The token cache is being invalidate because project 0d51ab494da9405f9c4a1a6db44e83da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:46:57.079511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:57.080167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-1bff463c-55b5-4e01-a6dc-b514f0f0480c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:46:57.081727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1378/2747] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:46:56 2022] DELETE /identity/v3/projects/0d51ab494da9405f9c4a1a6db44e83da => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:57.086890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab6ab-20dd-46cf-8933-68b5be75ab7e None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.087210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab6ab-20dd-46cf-8933-68b5be75ab7e None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.087493 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dab6ab-20dd-46cf-8933-68b5be75ab7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.105574 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-a6dab6ab-20dd-46cf-8933-68b5be75ab7e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:57.106771 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a6dab6ab-20dd-46cf-8933-68b5be75ab7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:57.163523 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1370/2748] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:57.171554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff43c-aaf4-48b4-9694-0251d65a293b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.171846 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff43c-aaf4-48b4-9694-0251d65a293b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.172126 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ff43c-aaf4-48b4-9694-0251d65a293b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.191075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-256ff43c-aaf4-48b4-9694-0251d65a293b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:57.192279 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-256ff43c-aaf4-48b4-9694-0251d65a293b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:57.200668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1379/2749] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:57.204874 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dab6ab-20dd-46cf-8933-68b5be75ab7e None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:57.214271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dab6ab-20dd-46cf-8933-68b5be75ab7e None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:57.218739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:57.219418 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.219699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.219973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.220701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:46:57.221004 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:57.222838 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:57.234007 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1371/2750] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:46:57.238156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ff43c-aaf4-48b4-9694-0251d65a293b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:57.248263 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ff43c-aaf4-48b4-9694-0251d65a293b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:57.252840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:57.253487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.253772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.254051 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.254737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:57.256656 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:57.343317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1380/2751] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:46:57 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:57.347656 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:57.357525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e970c4c-7bb7-4231-b088-b79e7a10955b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:57.412775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:57.413440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.413726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.414005 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.414696 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:57.416621 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:57.513736 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1372/2752] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:46:57 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:46:57.517711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:57.528631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2a0c-4f4d-4c42-ab69-5ec094355550 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:57.534188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:57.534188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.534659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.534659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.535479 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:57.537004 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:57.548108 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1381/2753] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:57.552118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:57.562742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad932cf-80c1-4134-b5c5-66e697876e48 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:57.567463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bd78f-8d31-4f71-b551-3ed3f3e383b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:57.568128 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd78f-8d31-4f71-b551-3ed3f3e383b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.568413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd78f-8d31-4f71-b551-3ed3f3e383b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.568686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bd78f-8d31-4f71-b551-3ed3f3e383b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.569555 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bd78f-8d31-4f71-b551-3ed3f3e383b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:57.571469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bd78f-8d31-4f71-b551-3ed3f3e383b8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:57.581847 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1373/2754] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:46:57.587081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:57.596164 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51807d98-9340-4852-82db-d64baedc7ea4 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:57.604554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:57.604554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.604554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.604554 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] PATH_INFO: `/v3/projects/52a3ef9251324a919127a8ab46102eb6/users/1c94c78dcfc5463bb858b9cebb1a4ff5/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.618875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52a3ef9251324a919127a8ab46102eb6, user_id=1c94c78dcfc5463bb858b9cebb1a4ff5, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:57.621619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:57.717965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1382/2755] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:46:57 2022] PUT /identity/v3/projects/52a3ef9251324a919127a8ab46102eb6/users/1c94c78dcfc5463bb858b9cebb1a4ff5/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:46:57.730224 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.730513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.730789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.757714 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] MFA Rules not processed for user `1c94c78dcfc5463bb858b9cebb1a4ff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:46:57.759320 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:57.823165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1374/2756] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:46:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:46:57.834378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:46:57.836670 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:46:57.893535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2d6a0-3f82-4408-a6ed-38fdd7a569f9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:46:57.897245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '69f37dda98124a8c8cf4406d985933f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:46:57.897942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:46:57.898222 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:46:57.898994 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:46:57.907185 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:46:57.908599 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:46:57.918149 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1383/2757] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:46:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:47:03.039511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:03.041623 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:03.099719 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04016f5f-28e1-4325-a625-999028ae7be1 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:03.103732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f81551-c6f9-4439-bd9f-e6a83e4cede6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:03.104487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f81551-c6f9-4439-bd9f-e6a83e4cede6 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:03.104655 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f81551-c6f9-4439-bd9f-e6a83e4cede6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:03.104933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f81551-c6f9-4439-bd9f-e6a83e4cede6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:03.106724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-30f81551-c6f9-4439-bd9f-e6a83e4cede6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:03.170923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f81551-c6f9-4439-bd9f-e6a83e4cede6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:03.172456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f81551-c6f9-4439-bd9f-e6a83e4cede6 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:03.182522 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1375/2758] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:47:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:47:27.141068 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:27.202852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423faf3-534d-45ab-8a7b-1ea803f90dc3 service glance] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:27.207355 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:27.208212 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:27.208491 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:27.208764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] PATH_INFO: `/v3/users/1c94c78dcfc5463bb858b9cebb1a4ff5` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:27.209937 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c94c78dcfc5463bb858b9cebb1a4ff5)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:27.211864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:27.394972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c94c78dcfc5463bb858b9cebb1a4ff5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:27.401711 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c94c78dcfc5463bb858b9cebb1a4ff5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:27.478673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c94c78dcfc5463bb858b9cebb1a4ff5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:27.491268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c94c78dcfc5463bb858b9cebb1a4ff5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:27.491912 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c94c78dcfc5463bb858b9cebb1a4ff5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:27.497837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1384/2759] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:47:27 2022] DELETE /identity/v3/users/1c94c78dcfc5463bb858b9cebb1a4ff5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:47:27.502671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:27.503176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:27.503176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:27.520109 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:47:27.521299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:27.579612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1376/2760] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:47:27.589493 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:27.591016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:27.651916 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df805d-b984-4bda-ac16-e6699c0a46e0 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:27.656088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:27.656701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:27.656982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:27.657256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:27.666047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:27.667578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:27.677350 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1385/2761] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:47:28.063553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:28.064974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:28.077984 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963525ef-82e2-4ac2-8a28-6eeceb2062e6 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:28.082553 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:28.083597 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:28.083890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:28.084365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] PATH_INFO: `/v3/projects/52a3ef9251324a919127a8ab46102eb6` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:28.085567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52a3ef9251324a919127a8ab46102eb6)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:28.087463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:28.176244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52a3ef9251324a919127a8ab46102eb6', 'request_id': 'req-d4596495-2696-4586-9365-dd5782ba0554'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:28.181383 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52a3ef9251324a919127a8ab46102eb6', 'request_id': 'req-d4596495-2696-4586-9365-dd5782ba0554'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:28.188301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52a3ef9251324a919127a8ab46102eb6', 'request_id': 'req-d4596495-2696-4586-9365-dd5782ba0554'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:28.264152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] The token cache is being invalidate because project 52a3ef9251324a919127a8ab46102eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:47:28.265478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:28.266119 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:28.267699 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1377/2762] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:47:28 2022] DELETE /identity/v3/projects/52a3ef9251324a919127a8ab46102eb6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:47:49.435750 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:49.437153 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:49.448364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b29f7b9-6bff-415b-a126-0ebb37ae28fa service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:49.497779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:49.498494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:49.498815 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:49.499135 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:49.501012 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:49.564444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:49.565865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:49.575915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1386/2763] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:47:53.557595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:53.562973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:53.572716 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4596495-2696-4586-9365-dd5782ba0554 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:53.577403 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:53.578269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:53.578558 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:53.578836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] PATH_INFO: `/v3/users/fe93eb8c93fb4cb4bec6f7cc2c03e1eb` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:53.580134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe93eb8c93fb4cb4bec6f7cc2c03e1eb)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:53.582075 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:53.801138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:53.876211 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:53.888068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:53.888749 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:53.896256 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-3145ae9e-ff68-419a-a1b7-025a19c5c7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe93eb8c93fb4cb4bec6f7cc2c03e1eb'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:53.902343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1378/2764] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:47:53 2022] DELETE /identity/v3/users/fe93eb8c93fb4cb4bec6f7cc2c03e1eb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:47:54.135855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:54.150673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e127c84c-ad81-42c1-9541-21eab2bfb8fb service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:54.201722 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:54.202573 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.202853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.203146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] PATH_INFO: `/v3/projects/bba0283b32bc4c54ae7cfcb1f984db42` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.204328 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba0283b32bc4c54ae7cfcb1f984db42)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:54.206277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:54.322009 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba0283b32bc4c54ae7cfcb1f984db42', 'request_id': 'req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:54.387445 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba0283b32bc4c54ae7cfcb1f984db42', 'request_id': 'req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:54.393175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba0283b32bc4c54ae7cfcb1f984db42', 'request_id': 'req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:54.404139 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] The token cache is being invalidate because project bba0283b32bc4c54ae7cfcb1f984db42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:47:54.404429 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:54.405056 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b1f2fb1e-0f40-4748-b63d-bb58b9757b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:54.406619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1387/2765] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:47:54 2022] DELETE /identity/v3/projects/bba0283b32bc4c54ae7cfcb1f984db42 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:47:54.413028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16bd2b-752c-4eba-abc7-1ca6ff0a1de0 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.413303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16bd2b-752c-4eba-abc7-1ca6ff0a1de0 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.413581 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff16bd2b-752c-4eba-abc7-1ca6ff0a1de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.431601 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-ff16bd2b-752c-4eba-abc7-1ca6ff0a1de0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:47:54.432790 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-ff16bd2b-752c-4eba-abc7-1ca6ff0a1de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:54.490124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1379/2766] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:47:54.498265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1011-6d04-442c-9587-ed373107e150 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.498557 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1011-6d04-442c-9587-ed373107e150 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.498837 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b1011-6d04-442c-9587-ed373107e150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.518749 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-2c8b1011-6d04-442c-9587-ed373107e150 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:47:54.520073 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-2c8b1011-6d04-442c-9587-ed373107e150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:54.528027 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1388/2767] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:47:54.532366 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16bd2b-752c-4eba-abc7-1ca6ff0a1de0 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:54.543102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff16bd2b-752c-4eba-abc7-1ca6ff0a1de0 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:54.547851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:54.548511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.550089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.550399 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.551168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:47:54.551487 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:54.553285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:54.569470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1380/2768] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:47:54.574373 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1011-6d04-442c-9587-ed373107e150 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:54.580311 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b1011-6d04-442c-9587-ed373107e150 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:54.586060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:54.586845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.587161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.587448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.588151 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:54.590060 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:54.690180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1389/2769] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:47:54 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:47:54.694827 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:54.704855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042c3ef-363d-4991-829f-a41c99861f2b admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:54.761933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:54.762604 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.762886 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.763206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.763910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:54.765833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:54.848708 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1381/2770] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:47:54 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:47:54.852917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:54.863228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8956456-6493-4e6b-9b2a-7b1064f5eb05 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:54.867866 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:54.868534 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.868803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.869084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.869810 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:54.871452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:54.881827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1390/2771] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:47:54.885804 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:54.896580 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21971cc-6d1d-4f02-ae5f-11cf4f2339d2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:54.901296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46a196-7c80-49bb-886a-7ea780bc4212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:54.901949 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a196-7c80-49bb-886a-7ea780bc4212 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.902237 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a196-7c80-49bb-886a-7ea780bc4212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.902518 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46a196-7c80-49bb-886a-7ea780bc4212 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.903293 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46a196-7c80-49bb-886a-7ea780bc4212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:54.904893 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46a196-7c80-49bb-886a-7ea780bc4212 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:54.916258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1382/2772] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:47:54.920394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:54.930462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47fb78-8fb2-4c38-9300-9dcae46e735f admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:54.937452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:54.938333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:54.938614 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:54.938894 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] PATH_INFO: `/v3/projects/66bb2fef29db4b6a8857457086f0e78f/users/22cdb991bf6a41638fde0575ddda2503/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:54.955075 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66bb2fef29db4b6a8857457086f0e78f, user_id=22cdb991bf6a41638fde0575ddda2503, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:54.958466 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:55.034058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1391/2773] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:47:54 2022] PUT /identity/v3/projects/66bb2fef29db4b6a8857457086f0e78f/users/22cdb991bf6a41638fde0575ddda2503/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:47:55.044842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f787c-5ee1-4d9a-9f82-976ef3f9ebd4 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:55.045136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f787c-5ee1-4d9a-9f82-976ef3f9ebd4 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:55.045420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f787c-5ee1-4d9a-9f82-976ef3f9ebd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:55.072430 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-de2f787c-5ee1-4d9a-9f82-976ef3f9ebd4 None None] MFA Rules not processed for user `22cdb991bf6a41638fde0575ddda2503`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:47:55.073662 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-de2f787c-5ee1-4d9a-9f82-976ef3f9ebd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:55.140400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1383/2774] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:47:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:47:55.151726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:55.153448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:55.244252 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f67aa-4c73-436f-90f8-723478235318 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:55.249730 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa794255-e66c-4a42-b7d4-71856df74e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd4bf9aaaae4483bade1570b1c1cfae7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:55.250376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794255-e66c-4a42-b7d4-71856df74e98 service nova] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:55.250659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794255-e66c-4a42-b7d4-71856df74e98 service nova] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:55.250935 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa794255-e66c-4a42-b7d4-71856df74e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:55.260203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794255-e66c-4a42-b7d4-71856df74e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:55.261794 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa794255-e66c-4a42-b7d4-71856df74e98 service nova] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:55.271367 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1392/2775] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:47:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:47:58.693175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f787c-5ee1-4d9a-9f82-976ef3f9ebd4 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:58.755782 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f787c-5ee1-4d9a-9f82-976ef3f9ebd4 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:58.760302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:58.761163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:58.761448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:58.761724 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] PATH_INFO: `/v3/users/22cdb991bf6a41638fde0575ddda2503` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:58.762898 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22cdb991bf6a41638fde0575ddda2503)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:58.764844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:58.966900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22cdb991bf6a41638fde0575ddda2503'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.082625 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22cdb991bf6a41638fde0575ddda2503'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.094939 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22cdb991bf6a41638fde0575ddda2503'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.095620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22cdb991bf6a41638fde0575ddda2503'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.103152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22cdb991bf6a41638fde0575ddda2503'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.108954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1384/2776] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:47:58 2022] DELETE /identity/v3/users/22cdb991bf6a41638fde0575ddda2503 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:47:59.113910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:59.114376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:59.114468 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:59.131892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:47:59.134732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:59.190783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1393/2777] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:47:59.200464 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:59.201852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:59.259051 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc6378-915d-4494-8765-90b9063873b7 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:59.262578 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45f1f65-cf76-4f6e-a5c4-103adb3d5969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:59.263249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1f65-cf76-4f6e-a5c4-103adb3d5969 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:59.263534 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1f65-cf76-4f6e-a5c4-103adb3d5969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:59.263810 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45f1f65-cf76-4f6e-a5c4-103adb3d5969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:59.273029 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1f65-cf76-4f6e-a5c4-103adb3d5969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:59.274458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45f1f65-cf76-4f6e-a5c4-103adb3d5969 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:59.283624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1385/2778] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:47:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:47:59.698441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:47:59.699953 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:47:59.712829 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e9f97-5143-4ed0-9bf9-7eb74ed937e2 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:47:59.717605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:47:59.718467 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:59.718753 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:59.719033 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] PATH_INFO: `/v3/projects/66bb2fef29db4b6a8857457086f0e78f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:59.720294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66bb2fef29db4b6a8857457086f0e78f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:47:59.722822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:47:59.833924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66bb2fef29db4b6a8857457086f0e78f', 'request_id': 'req-624be8fa-6cde-429b-a752-c8bed33616b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.921742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66bb2fef29db4b6a8857457086f0e78f', 'request_id': 'req-624be8fa-6cde-429b-a752-c8bed33616b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.927997 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66bb2fef29db4b6a8857457086f0e78f', 'request_id': 'req-624be8fa-6cde-429b-a752-c8bed33616b5'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.938828 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] The token cache is being invalidate because project 66bb2fef29db4b6a8857457086f0e78f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:47:59.939143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.939778 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-624be8fa-6cde-429b-a752-c8bed33616b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:47:59.941431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1394/2779] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:47:59 2022] DELETE /identity/v3/projects/66bb2fef29db4b6a8857457086f0e78f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:47:59.946888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d725-636c-49f5-b619-431bec706eae None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:47:59.947406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d725-636c-49f5-b619-431bec706eae None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:47:59.947490 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d725-636c-49f5-b619-431bec706eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:47:59.966967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-79b8d725-636c-49f5-b619-431bec706eae None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:47:59.969856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-79b8d725-636c-49f5-b619-431bec706eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:00.029149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1386/2780] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:00.037391 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059449-809a-459d-909a-1e4957c1cfc1 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.037688 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059449-809a-459d-909a-1e4957c1cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.037971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee059449-809a-459d-909a-1e4957c1cfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.057129 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ee059449-809a-459d-909a-1e4957c1cfc1 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:00.058365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ee059449-809a-459d-909a-1e4957c1cfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:00.066140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1395/2781] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:00.070988 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8d725-636c-49f5-b619-431bec706eae None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:00.080409 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8d725-636c-49f5-b619-431bec706eae None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:00.085067 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:00.085651 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.085918 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.086196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.086927 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:48:00.087271 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:00.088857 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:00.100363 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1387/2782] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:48:00.104345 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee059449-809a-459d-909a-1e4957c1cfc1 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:00.113297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee059449-809a-459d-909a-1e4957c1cfc1 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:00.118920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:00.119600 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.119885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.120166 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.120850 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:00.122744 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:00.201140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1396/2783] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:48:00 2022] POST /identity/v3/projects => generated 363 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:00.205022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:00.215097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de8f00-1c53-4b24-8701-2fcf924c08d8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:00.270350 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:00.271022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.271337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.271620 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.272348 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:00.274265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:00.341507 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1388/2784] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:48:00 2022] POST /identity/v3/users => generated 282 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:48:00.345825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:00.356703 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22f0af-82d6-4a4b-b827-4a017cba38a1 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:00.361384 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:00.362039 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.365320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.365320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.365320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:00.365609 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:00.375901 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1397/2785] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:00.379785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:00.389544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947285e8-efa2-44ba-8997-b48f05c0bd28 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:00.394198 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fae906-eece-46f5-b267-8796405f3d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:00.394981 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae906-eece-46f5-b267-8796405f3d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.395305 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae906-eece-46f5-b267-8796405f3d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.395583 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae906-eece-46f5-b267-8796405f3d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.396315 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fae906-eece-46f5-b267-8796405f3d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:00.397895 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fae906-eece-46f5-b267-8796405f3d05 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:00.407576 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1389/2786] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:00.412144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:00.421925 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7bceb5-9272-4c83-bf14-e713df8da79b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:00.427224 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:00.428136 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.428415 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.428689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] PATH_INFO: `/v3/projects/a1948b05760b488e8eca9ea32a04be77/users/7f00522cb7c24d7ba3c4cba78b6f179f/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.442782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1948b05760b488e8eca9ea32a04be77, user_id=7f00522cb7c24d7ba3c4cba78b6f179f, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:00.445549 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:00.510654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1398/2787] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:00 2022] PUT /identity/v3/projects/a1948b05760b488e8eca9ea32a04be77/users/7f00522cb7c24d7ba3c4cba78b6f179f/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:00.521748 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd65a8-6b29-465b-a348-ac640049b4af None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.522040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd65a8-6b29-465b-a348-ac640049b4af None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.522331 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd65a8-6b29-465b-a348-ac640049b4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.549420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-94cd65a8-6b29-465b-a348-ac640049b4af None None] MFA Rules not processed for user `7f00522cb7c24d7ba3c4cba78b6f179f`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:00.550617 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-94cd65a8-6b29-465b-a348-ac640049b4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:00.616314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1390/2788] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:00.627084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:00.628876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:00.685936 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cb873-5088-4ba6-b42d-64515ec98ebb admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:00.689695 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f013e7b-f741-49dd-b31b-2e12e934de42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:00.690348 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013e7b-f741-49dd-b31b-2e12e934de42 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:00.690631 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013e7b-f741-49dd-b31b-2e12e934de42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:00.690910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f013e7b-f741-49dd-b31b-2e12e934de42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:00.700424 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f013e7b-f741-49dd-b31b-2e12e934de42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:00.701875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f013e7b-f741-49dd-b31b-2e12e934de42 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:00.710868 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1399/2789] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:00 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:10.489055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd65a8-6b29-465b-a348-ac640049b4af None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:10.550213 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd65a8-6b29-465b-a348-ac640049b4af None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:10.560132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:10.560132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:10.560132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:10.560132 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] PATH_INFO: `/v3/users/7f00522cb7c24d7ba3c4cba78b6f179f` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:10.560459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f00522cb7c24d7ba3c4cba78b6f179f)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:10.560459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:10.749021 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f00522cb7c24d7ba3c4cba78b6f179f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:10.836166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f00522cb7c24d7ba3c4cba78b6f179f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:10.848843 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f00522cb7c24d7ba3c4cba78b6f179f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:10.849468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f00522cb7c24d7ba3c4cba78b6f179f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:10.856389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f00522cb7c24d7ba3c4cba78b6f179f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:10.862199 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1391/2790] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:48:10 2022] DELETE /identity/v3/users/7f00522cb7c24d7ba3c4cba78b6f179f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:10.866709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:10.867183 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:10.867293 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:10.884642 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:10.886163 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:10.942646 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1400/2791] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:10.953695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:10.955138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:11.013040 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff4669-fb24-490a-b278-1b0fc9d54b52 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:11.016589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12548cec-49ed-4675-8844-56cd14b5cf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:11.017258 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12548cec-49ed-4675-8844-56cd14b5cf1b service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:11.017595 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12548cec-49ed-4675-8844-56cd14b5cf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:11.017914 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12548cec-49ed-4675-8844-56cd14b5cf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:11.026641 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12548cec-49ed-4675-8844-56cd14b5cf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:11.028138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12548cec-49ed-4675-8844-56cd14b5cf1b service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:11.037585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1392/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:11.411522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:11.413144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:11.426175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d7bed-fbba-4207-9016-f3831b00cc81 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:11.430105 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:11.431892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:11.432197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:11.432473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] PATH_INFO: `/v3/projects/a1948b05760b488e8eca9ea32a04be77` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:11.433691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1948b05760b488e8eca9ea32a04be77)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:11.435657 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:11.550574 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1948b05760b488e8eca9ea32a04be77', 'request_id': 'req-41a63e00-f9da-4a16-b172-c32c6ae8de84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:11.621713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1948b05760b488e8eca9ea32a04be77', 'request_id': 'req-41a63e00-f9da-4a16-b172-c32c6ae8de84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:11.627532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1948b05760b488e8eca9ea32a04be77', 'request_id': 'req-41a63e00-f9da-4a16-b172-c32c6ae8de84'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:11.639025 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] The token cache is being invalidate because project a1948b05760b488e8eca9ea32a04be77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:48:11.641188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:11.641188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-41a63e00-f9da-4a16-b172-c32c6ae8de84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:11.641511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1401/2793] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:48:11 2022] DELETE /identity/v3/projects/a1948b05760b488e8eca9ea32a04be77 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:11.646568 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1857a9-5d4a-42ec-8c0b-92a5f428af00 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:11.647024 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1857a9-5d4a-42ec-8c0b-92a5f428af00 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:11.647280 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1857a9-5d4a-42ec-8c0b-92a5f428af00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:11.664786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5e1857a9-5d4a-42ec-8c0b-92a5f428af00 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:11.667563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5e1857a9-5d4a-42ec-8c0b-92a5f428af00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:11.724407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1393/2794] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:11.733380 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed1b4-09f0-4903-9205-2af3845758df None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:11.733674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed1b4-09f0-4903-9205-2af3845758df None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:11.734034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ed1b4-09f0-4903-9205-2af3845758df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:11.751941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-ff4ed1b4-09f0-4903-9205-2af3845758df None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:11.753140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ff4ed1b4-09f0-4903-9205-2af3845758df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:11.761294 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1402/2795] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:11.765546 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1857a9-5d4a-42ec-8c0b-92a5f428af00 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:11.775606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1857a9-5d4a-42ec-8c0b-92a5f428af00 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:11.780064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:11.780717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:11.780993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:11.781268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:11.781991 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:48:11.782298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:11.783926 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:11.796089 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1394/2796] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:48:11.800203 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ed1b4-09f0-4903-9205-2af3845758df None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:11.809471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ed1b4-09f0-4903-9205-2af3845758df None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:11.814005 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:11.814652 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:11.814943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:11.815256 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:11.815952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:11.817843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:11.943428 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1403/2797] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:48:11 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:11.947478 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:11.957374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca969d-5b89-4046-9520-ebe2b895c884 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.014365 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.015035 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.015353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.015637 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.016337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.018247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.124973 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1395/2798] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:48:11 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:48:12.129071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.139980 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e457802-b6e8-4bb2-bf85-7236427322e6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.144633 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.145285 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.145566 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.145886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.146655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.148297 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.159480 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1404/2799] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:12.163254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.173013 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab64d-e6ad-46a2-84bc-e1b99b9022fb admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.177613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e98a4-28ef-4ece-b787-602a56d70fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.178253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e98a4-28ef-4ece-b787-602a56d70fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.178536 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e98a4-28ef-4ece-b787-602a56d70fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.178807 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e98a4-28ef-4ece-b787-602a56d70fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.179562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e98a4-28ef-4ece-b787-602a56d70fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.181275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e98a4-28ef-4ece-b787-602a56d70fbf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.190761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1396/2800] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:48:12.194693 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.204946 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d019b-d887-45aa-af95-5bb6e2b68bb8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.209514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.210401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.210682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.210958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] PATH_INFO: `/v3/projects/1a94b5ae76604ceca91d220b1eeab91f/users/31a7a69491bd4308bfc11c5514b9a487/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.225890 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a94b5ae76604ceca91d220b1eeab91f, user_id=31a7a69491bd4308bfc11c5514b9a487, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.228966 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.386318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1405/2801] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:12 2022] PUT /identity/v3/projects/1a94b5ae76604ceca91d220b1eeab91f/users/31a7a69491bd4308bfc11c5514b9a487/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:48:12.397528 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0fea-b479-4c95-8926-3ba230033df2 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.397819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0fea-b479-4c95-8926-3ba230033df2 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.398127 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a0fea-b479-4c95-8926-3ba230033df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.425364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-c19a0fea-b479-4c95-8926-3ba230033df2 None None] MFA Rules not processed for user `31a7a69491bd4308bfc11c5514b9a487`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:12.426610 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-c19a0fea-b479-4c95-8926-3ba230033df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:12.489602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1397/2802] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:12.494611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.554982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deac9e5-e070-431b-be41-b4e2984bfe5c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.560089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.560772 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.561058 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.561366 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.562055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.564024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.637902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1406/2803] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:48:12 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 10 21:48:12.642009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0fea-b479-4c95-8926-3ba230033df2 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.653352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a0fea-b479-4c95-8926-3ba230033df2 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.707295 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.707962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.708249 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.708526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.709218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.711111 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.818900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1398/2804] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:48:12 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:12.823392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.833635 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71eb3f-8e4a-45cf-90a7-e41a77b0254c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.838879 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.839578 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.839863 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.840143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.840970 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.842571 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.854536 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1407/2805] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:12.859899 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.869993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a1bb8-b715-4907-96ee-d4c820334af9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:12.874701 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:12.875636 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:12.875921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:12.876314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] PATH_INFO: `/v3/projects/b02fd195f40f4f8ca34a5aae97b674af/users/62c727c798af4fd18880b90f534617bc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:12.891533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02fd195f40f4f8ca34a5aae97b674af, user_id=62c727c798af4fd18880b90f534617bc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:12.894140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:12.962391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1399/2806] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:12 2022] PUT /identity/v3/projects/b02fd195f40f4f8ca34a5aae97b674af/users/62c727c798af4fd18880b90f534617bc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:12.966326 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:12.976533 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00464f-4b36-4b5c-81f3-369a54f08f3b admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:13.031018 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b04e7-109f-4930-94a1-551d463b1e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:13.031701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b04e7-109f-4930-94a1-551d463b1e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:13.031982 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b04e7-109f-4930-94a1-551d463b1e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:13.032257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b04e7-109f-4930-94a1-551d463b1e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:13.032971 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b04e7-109f-4930-94a1-551d463b1e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:13.034563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b04e7-109f-4930-94a1-551d463b1e60 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:13.044065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1408/2807] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:13.048156 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:13.058529 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac27c16-b941-4ae0-bf59-56d051043719 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:13.063250 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:13.064123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:13.064407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:13.064684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] PATH_INFO: `/v3/projects/b02fd195f40f4f8ca34a5aae97b674af/users/62c727c798af4fd18880b90f534617bc/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:13.066697 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b02fd195f40f4f8ca34a5aae97b674af, user_id=62c727c798af4fd18880b90f534617bc, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:13.069389 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:13.079870 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1400/2808] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:13 2022] PUT /identity/v3/projects/b02fd195f40f4f8ca34a5aae97b674af/users/62c727c798af4fd18880b90f534617bc/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:48:13.089735 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79627c5c-173a-43a1-90b1-2b0f39e7095f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:13.090029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79627c5c-173a-43a1-90b1-2b0f39e7095f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:13.090312 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79627c5c-173a-43a1-90b1-2b0f39e7095f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:13.116331 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-79627c5c-173a-43a1-90b1-2b0f39e7095f None None] MFA Rules not processed for user `62c727c798af4fd18880b90f534617bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:13.117539 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-79627c5c-173a-43a1-90b1-2b0f39e7095f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:13.184318 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1409/2809] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:13 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:13.195624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:13.197887 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:13.254168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e383-b576-43b9-89e0-dc17431dd26f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:13.257792 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:13.258432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:13.259163 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:13.259468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:13.268311 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:13.269726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:13.279055 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1401/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:13 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:13.476761 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79627c5c-173a-43a1-90b1-2b0f39e7095f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:13.487361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79627c5c-173a-43a1-90b1-2b0f39e7095f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:13.490838 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46294234-f52b-4201-9311-c0efc0127e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:13.491501 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294234-f52b-4201-9311-c0efc0127e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:13.491783 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294234-f52b-4201-9311-c0efc0127e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:13.492054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46294234-f52b-4201-9311-c0efc0127e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:13.546668 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46294234-f52b-4201-9311-c0efc0127e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:13.548150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46294234-f52b-4201-9311-c0efc0127e77 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:13.557947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1410/2811] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:16.933535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:16.995059 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed8704-89d7-4fc9-beb5-8d58e9a2c85a service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:16.999654 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:17.000526 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:17.000816 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:17.001093 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] PATH_INFO: `/v3/users/31a7a69491bd4308bfc11c5514b9a487` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:17.002279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a7a69491bd4308bfc11c5514b9a487)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:17.004210 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:17.260667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a7a69491bd4308bfc11c5514b9a487'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:17.344707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a7a69491bd4308bfc11c5514b9a487'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:17.358239 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a7a69491bd4308bfc11c5514b9a487'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:17.359110 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a7a69491bd4308bfc11c5514b9a487'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:17.367445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a7a69491bd4308bfc11c5514b9a487'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:17.373246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1402/2812] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:48:16 2022] DELETE /identity/v3/users/31a7a69491bd4308bfc11c5514b9a487 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:17.377803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:17.378269 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:17.378395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:17.395891 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:17.397089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:17.455101 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1411/2813] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:17.466440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:17.467903 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:17.524689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f782358-317b-4f1d-af6e-2404fd68044f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:17.529240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:17.529883 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:17.530164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:17.530440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:17.539520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:17.542942 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:17.552367 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1403/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:17.950041 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:17.951576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:17.964365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f08c8-97f6-471b-9ca0-697b5ee006c3 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:17.969079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:17.969943 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:17.970220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:17.970494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] PATH_INFO: `/v3/projects/1a94b5ae76604ceca91d220b1eeab91f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:17.971709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a94b5ae76604ceca91d220b1eeab91f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:17.973969 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:18.082202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a94b5ae76604ceca91d220b1eeab91f', 'request_id': 'req-d9d985cc-3d75-4010-90cc-7e4f7a087812'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.141544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a94b5ae76604ceca91d220b1eeab91f', 'request_id': 'req-d9d985cc-3d75-4010-90cc-7e4f7a087812'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.147333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a94b5ae76604ceca91d220b1eeab91f', 'request_id': 'req-d9d985cc-3d75-4010-90cc-7e4f7a087812'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.158877 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] The token cache is being invalidate because project 1a94b5ae76604ceca91d220b1eeab91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:48:18.159195 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.159852 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.161382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1412/2815] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:48:17 2022] DELETE /identity/v3/projects/1a94b5ae76604ceca91d220b1eeab91f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:48:18.165290 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:18.176327 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc5e6-c526-4805-ba2d-9831af482629 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:18.231876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:18.232776 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:18.233063 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:18.233337 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] PATH_INFO: `/v3/users/62c727c798af4fd18880b90f534617bc` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:18.234517 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c727c798af4fd18880b90f534617bc)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:18.236456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:18.446175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c727c798af4fd18880b90f534617bc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.527782 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c727c798af4fd18880b90f534617bc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.539798 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c727c798af4fd18880b90f534617bc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.540426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c727c798af4fd18880b90f534617bc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.547254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-fef300b7-993f-4717-9e21-6f16e1ecbe79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c727c798af4fd18880b90f534617bc'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:18.552970 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1404/2816] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:48:18 2022] DELETE /identity/v3/users/62c727c798af4fd18880b90f534617bc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:19.214840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:19.216342 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:19.230929 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d985cc-3d75-4010-90cc-7e4f7a087812 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:19.286941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:19.287745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.288024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.288296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] PATH_INFO: `/v3/projects/b02fd195f40f4f8ca34a5aae97b674af` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.289474 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b02fd195f40f4f8ca34a5aae97b674af)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:19.291913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:19.384706 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b02fd195f40f4f8ca34a5aae97b674af', 'request_id': 'req-b3680a4d-e730-40fb-8a51-7519cfb61e1d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:19.453315 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b02fd195f40f4f8ca34a5aae97b674af', 'request_id': 'req-b3680a4d-e730-40fb-8a51-7519cfb61e1d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:19.458910 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b02fd195f40f4f8ca34a5aae97b674af', 'request_id': 'req-b3680a4d-e730-40fb-8a51-7519cfb61e1d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:19.470169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] The token cache is being invalidate because project b02fd195f40f4f8ca34a5aae97b674af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:48:19.470456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:19.471082 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b3680a4d-e730-40fb-8a51-7519cfb61e1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:19.472899 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1413/2817] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:48:19 2022] DELETE /identity/v3/projects/b02fd195f40f4f8ca34a5aae97b674af => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:19.478164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554820b8-440b-46a0-b9e6-a043ecb9bf93 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.479266 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554820b8-440b-46a0-b9e6-a043ecb9bf93 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.479391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554820b8-440b-46a0-b9e6-a043ecb9bf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.497278 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-554820b8-440b-46a0-b9e6-a043ecb9bf93 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:19.498472 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-554820b8-440b-46a0-b9e6-a043ecb9bf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:19.559545 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1405/2818] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:19.564097 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf529-30b9-4158-a1fd-bf935aa56d6b None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.564382 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf529-30b9-4158-a1fd-bf935aa56d6b None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.564662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcf529-30b9-4158-a1fd-bf935aa56d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.582806 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-e8dcf529-30b9-4158-a1fd-bf935aa56d6b None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:19.584029 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-e8dcf529-30b9-4158-a1fd-bf935aa56d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:19.592942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1414/2819] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 10 21:48:19.597468 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554820b8-440b-46a0-b9e6-a043ecb9bf93 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:19.609667 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554820b8-440b-46a0-b9e6-a043ecb9bf93 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:19.613977 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:19.614658 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.614928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.615241 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.615989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:48:19.616301 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:19.617960 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:19.630072 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1406/2820] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:48:19.634665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf529-30b9-4158-a1fd-bf935aa56d6b None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:19.644013 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcf529-30b9-4158-a1fd-bf935aa56d6b None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:19.648757 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:19.649431 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.653627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.653627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.653627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:19.653627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:19.737622 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1415/2821] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:48:19 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:19.741846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:19.753240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5aa025-eb71-4342-a8ba-fac6afef8d47 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:19.809152 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:19.809877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.810112 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.810392 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.811092 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:19.813064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:19.919448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1407/2822] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:48:19 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:19.923658 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:19.934858 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61365b-df57-4f6a-89f1-5127aecf0a0a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:19.939731 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:19.940476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.940759 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.941034 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.941758 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:19.943389 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:19.954804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1416/2823] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:19.958783 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:19.969631 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca4c3b-40ff-42a3-9f84-b56e1ff1d843 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:19.974596 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59656561-fbb9-4eda-b8ac-a2d1127bfa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:19.975282 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656561-fbb9-4eda-b8ac-a2d1127bfa81 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:19.975570 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656561-fbb9-4eda-b8ac-a2d1127bfa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:19.975851 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59656561-fbb9-4eda-b8ac-a2d1127bfa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:19.976586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59656561-fbb9-4eda-b8ac-a2d1127bfa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:19.978175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59656561-fbb9-4eda-b8ac-a2d1127bfa81 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:19.987846 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1408/2824] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:19.991989 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:20.001782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c57db-5f30-463f-975a-31f8cc5d817e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:20.006392 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:20.007321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:20.007596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:20.007878 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] PATH_INFO: `/v3/projects/a2158979b8b0480b916809ade8fe9015/users/98389c96203d41fa97678c2d1d27db5f/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:20.022965 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2158979b8b0480b916809ade8fe9015, user_id=98389c96203d41fa97678c2d1d27db5f, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:20.026353 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:20.124443 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1417/2825] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:19 2022] PUT /identity/v3/projects/a2158979b8b0480b916809ade8fe9015/users/98389c96203d41fa97678c2d1d27db5f/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:20.186917 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487987c-42f8-4fc3-95fd-2b33ba269b86 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:20.187252 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487987c-42f8-4fc3-95fd-2b33ba269b86 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:20.187535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487987c-42f8-4fc3-95fd-2b33ba269b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:20.214147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-5487987c-42f8-4fc3-95fd-2b33ba269b86 None None] MFA Rules not processed for user `98389c96203d41fa97678c2d1d27db5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:20.215387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5487987c-42f8-4fc3-95fd-2b33ba269b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:20.277896 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1409/2826] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:20.282430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:20.343400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263ebcb-8cec-4940-a4bf-b8b6d6dfd678 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:20.348324 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:20.348981 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:20.349265 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:20.349542 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:20.350228 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:20.352192 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:20.470462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1418/2827] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:48:20 2022] POST /identity/v3/projects => generated 369 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:20.470707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487987c-42f8-4fc3-95fd-2b33ba269b86 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:20.470707 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487987c-42f8-4fc3-95fd-2b33ba269b86 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:20.525611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:20.526372 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:20.526575 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:20.526852 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:20.527585 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:20.529482 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:20.794140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1410/2828] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:48:20 2022] POST /identity/v3/users => generated 291 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:20.798204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:20.809089 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d246b-b0e2-47e2-99b1-bf2e26de6cb2 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:20.814483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:20.814483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:20.814780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:20.815048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:20.815922 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:20.817577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:20.829023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1419/2829] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:48:20.833172 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:20.843265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af1c3d-325b-47c5-9d27-8064e4080aa0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:20.848008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:20.848906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:20.849189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:20.849469 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] PATH_INFO: `/v3/projects/3910af69f8f14b1ba5b8e8a16b0a9675/users/c2f9e32222c045fc9bec4217a3999e36/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:20.864385 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3910af69f8f14b1ba5b8e8a16b0a9675, user_id=c2f9e32222c045fc9bec4217a3999e36, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:20.867081 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:20.959071 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1411/2830] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:20 2022] PUT /identity/v3/projects/3910af69f8f14b1ba5b8e8a16b0a9675/users/c2f9e32222c045fc9bec4217a3999e36/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:20.963227 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:20.973419 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd2460-3541-4560-9e13-ccf5cc999b42 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:21.027856 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1e85a-25f1-4f48-bba0-c8a7a0cb25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:21.028520 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e85a-25f1-4f48-bba0-c8a7a0cb25f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:21.028804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e85a-25f1-4f48-bba0-c8a7a0cb25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:21.029081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1e85a-25f1-4f48-bba0-c8a7a0cb25f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:21.029804 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e85a-25f1-4f48-bba0-c8a7a0cb25f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:21.031432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa1e85a-25f1-4f48-bba0-c8a7a0cb25f8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:21.041634 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1420/2831] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:21.045884 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:21.055900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a4243-254a-4ea5-8491-041efcfb338f admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:21.061259 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:21.062138 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:21.062406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:21.062710 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] PATH_INFO: `/v3/projects/3910af69f8f14b1ba5b8e8a16b0a9675/users/c2f9e32222c045fc9bec4217a3999e36/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:21.064687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3910af69f8f14b1ba5b8e8a16b0a9675, user_id=c2f9e32222c045fc9bec4217a3999e36, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:21.067325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:21.077332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1412/2832] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:21 2022] PUT /identity/v3/projects/3910af69f8f14b1ba5b8e8a16b0a9675/users/c2f9e32222c045fc9bec4217a3999e36/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:48:21.087081 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed82c-8d63-44e6-8edc-873c346e3218 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:21.087403 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed82c-8d63-44e6-8edc-873c346e3218 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:21.087687 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed82c-8d63-44e6-8edc-873c346e3218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:21.115352 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-28aed82c-8d63-44e6-8edc-873c346e3218 None None] MFA Rules not processed for user `c2f9e32222c045fc9bec4217a3999e36`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:21.116559 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-28aed82c-8d63-44e6-8edc-873c346e3218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:21.183847 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1421/2833] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:21.196856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:21.198811 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:21.254298 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001c13-a0e2-484f-8fbf-4215a56aabc9 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:21.257879 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1979302-90ab-4958-9110-246cee7fe3fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:21.258511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979302-90ab-4958-9110-246cee7fe3fc service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:21.258796 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979302-90ab-4958-9110-246cee7fe3fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:21.259070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1979302-90ab-4958-9110-246cee7fe3fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:21.268083 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1979302-90ab-4958-9110-246cee7fe3fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:21.269502 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1979302-90ab-4958-9110-246cee7fe3fc service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:21.279486 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1413/2834] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:23.900713 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aed82c-8d63-44e6-8edc-873c346e3218 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:23.960225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aed82c-8d63-44e6-8edc-873c346e3218 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:23.964813 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:23.966739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:23.966739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:23.966739 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] PATH_INFO: `/v3/users/98389c96203d41fa97678c2d1d27db5f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:23.967700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98389c96203d41fa97678c2d1d27db5f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:23.969676 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:24.114452 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98389c96203d41fa97678c2d1d27db5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.120972 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98389c96203d41fa97678c2d1d27db5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.172855 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98389c96203d41fa97678c2d1d27db5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.185697 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98389c96203d41fa97678c2d1d27db5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.198388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98389c96203d41fa97678c2d1d27db5f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.198388 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1422/2835] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:48:23 2022] DELETE /identity/v3/users/98389c96203d41fa97678c2d1d27db5f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:24.198600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:24.198600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:24.198600 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:24.214437 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:24.215835 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:24.273361 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1414/2836] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:24.286172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:24.286172 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:24.340314 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa32d593-147a-4d32-87b9-7a125bc02ba9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:24.343880 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:24.344516 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:24.344795 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:24.345066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:24.354128 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:24.355647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:24.365525 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1423/2837] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:24.778265 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:24.779808 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:24.794481 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b061700-aeb7-4ccc-b09c-07655af3aec9 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:24.799520 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:24.800397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:24.800678 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:24.800980 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] PATH_INFO: `/v3/projects/a2158979b8b0480b916809ade8fe9015` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:24.802170 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2158979b8b0480b916809ade8fe9015)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:24.804551 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:24.901834 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2158979b8b0480b916809ade8fe9015', 'request_id': 'req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.907945 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2158979b8b0480b916809ade8fe9015', 'request_id': 'req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.913982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2158979b8b0480b916809ade8fe9015', 'request_id': 'req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.984188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] The token cache is being invalidate because project a2158979b8b0480b916809ade8fe9015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:48:24.984476 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.985124 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:24.986669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1415/2838] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:48:24 2022] DELETE /identity/v3/projects/a2158979b8b0480b916809ade8fe9015 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:24.990576 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:25.000167 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2c589-a1f8-4a9b-8d97-6464237fced3 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:25.056674 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:25.057544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:25.057827 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:25.058104 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] PATH_INFO: `/v3/users/c2f9e32222c045fc9bec4217a3999e36` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:25.059321 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2f9e32222c045fc9bec4217a3999e36)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:25.061242 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:25.251853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2f9e32222c045fc9bec4217a3999e36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:25.258471 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2f9e32222c045fc9bec4217a3999e36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:25.319150 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2f9e32222c045fc9bec4217a3999e36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:25.331500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2f9e32222c045fc9bec4217a3999e36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:25.332132 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-48d139fa-66d1-4204-aebc-9f9a69525113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2f9e32222c045fc9bec4217a3999e36'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:25.337905 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1424/2839] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:48:24 2022] DELETE /identity/v3/users/c2f9e32222c045fc9bec4217a3999e36 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:25.731844 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:25.733407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:25.747560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04d95a-f7b5-4065-8fb6-03a43b8f0522 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:25.804426 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:25.805227 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:25.805495 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:25.805773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] PATH_INFO: `/v3/projects/3910af69f8f14b1ba5b8e8a16b0a9675` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:25.806959 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3910af69f8f14b1ba5b8e8a16b0a9675)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:25.808894 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:25.974591 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3910af69f8f14b1ba5b8e8a16b0a9675', 'request_id': 'req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:25.980118 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3910af69f8f14b1ba5b8e8a16b0a9675', 'request_id': 'req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:25.986589 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3910af69f8f14b1ba5b8e8a16b0a9675', 'request_id': 'req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:26.052133 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] The token cache is being invalidate because project 3910af69f8f14b1ba5b8e8a16b0a9675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:48:26.052433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:26.053134 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-6f3d7099-9e74-4bb7-83b3-3a30629d9c6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:26.056285 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1416/2840] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:48:25 2022] DELETE /identity/v3/projects/3910af69f8f14b1ba5b8e8a16b0a9675 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:26.060605 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269bed0-89ea-48b0-8b1f-b46cee08eac0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.061079 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269bed0-89ea-48b0-8b1f-b46cee08eac0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.061175 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269bed0-89ea-48b0-8b1f-b46cee08eac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.079906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-0269bed0-89ea-48b0-8b1f-b46cee08eac0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:26.081077 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-0269bed0-89ea-48b0-8b1f-b46cee08eac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:26.136619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1425/2841] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:26.144907 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00eec5-a297-4793-a3a8-db62a12015fc None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.145196 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00eec5-a297-4793-a3a8-db62a12015fc None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.145474 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00eec5-a297-4793-a3a8-db62a12015fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.163080 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-fa00eec5-a297-4793-a3a8-db62a12015fc None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:26.164284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-fa00eec5-a297-4793-a3a8-db62a12015fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:26.172074 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1417/2842] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:26.176047 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269bed0-89ea-48b0-8b1f-b46cee08eac0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.186741 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269bed0-89ea-48b0-8b1f-b46cee08eac0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:26.191488 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:26.192144 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.192425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.192700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] PATH_INFO: `/v3/domains` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.193420 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80290) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:48:26.193725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:26.195356 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:26.207560 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1426/2843] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:48:26.213177 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00eec5-a297-4793-a3a8-db62a12015fc None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.222346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00eec5-a297-4793-a3a8-db62a12015fc None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:26.227275 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:26.227925 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.228240 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.228524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.229232 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:26.231218 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:26.318333 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1418/2844] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:48:26 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:26.322584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.332736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56077930-7c49-445a-8c42-7fb83fd8c285 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:26.395476 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:26.396145 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.396425 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.396701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.397395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:26.399584 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:26.488302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1427/2845] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:48:26 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:26.492222 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.503347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419359d-2b89-425c-9551-79ab08b37e54 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:26.508065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:26.508801 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.509088 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.509368 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.510096 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:26.511732 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:26.522989 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1419/2846] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 10 21:48:26.526835 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.537014 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8356e0f-eeee-4653-93aa-65a9f84e9f57 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:26.541570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d1acf-52df-4719-8b2c-1a3c1a889e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:26.542216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d1acf-52df-4719-8b2c-1a3c1a889e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.542497 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d1acf-52df-4719-8b2c-1a3c1a889e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.542768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d1acf-52df-4719-8b2c-1a3c1a889e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.544011 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d1acf-52df-4719-8b2c-1a3c1a889e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:26.545665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d1acf-52df-4719-8b2c-1a3c1a889e8b admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:26.555306 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1428/2847] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:26.559976 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.569965 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69dfb-79ed-45cf-a0e4-f39341198956 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:26.574533 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:26.575457 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.575740 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.576014 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] PATH_INFO: `/v3/projects/41a3cb8e4cf64668bb7b89385b8a0749/users/757785da38fb48018f10687711b9ce35/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.590086 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41a3cb8e4cf64668bb7b89385b8a0749, user_id=757785da38fb48018f10687711b9ce35, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:26.592937 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:26.659299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1420/2848] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:26 2022] PUT /identity/v3/projects/41a3cb8e4cf64668bb7b89385b8a0749/users/757785da38fb48018f10687711b9ce35/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:48:26.670090 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99238963-753e-4350-97c4-15e837fe667f None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.670378 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99238963-753e-4350-97c4-15e837fe667f None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.670654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99238963-753e-4350-97c4-15e837fe667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.697701 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-99238963-753e-4350-97c4-15e837fe667f None None] MFA Rules not processed for user `757785da38fb48018f10687711b9ce35`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:26.698938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-99238963-753e-4350-97c4-15e837fe667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:26.761284 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1429/2849] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:26.765888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.824643 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f498e57-380d-44ba-9745-e75ffc3c69b8 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:26.829380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:26.830022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:26.830303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:26.830579 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:26.831289 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:26.833168 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:26.937377 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1421/2850] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:48:26 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:26.941327 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99238963-753e-4350-97c4-15e837fe667f None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:26.952296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99238963-753e-4350-97c4-15e837fe667f None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:27.005545 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:27.006205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:27.006487 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:27.006763 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] PATH_INFO: `/v3/users` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:27.007500 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:27.009395 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:27.079310 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1430/2851] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:48:26 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:48:27.083463 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:27.093850 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3aa38-1d2a-4441-bc25-152611b310e3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:27.098754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:27.099443 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:27.099728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:27.100406 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:27.100729 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:27.102300 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:27.113230 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1422/2852] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:27.117290 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:27.127727 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436e579-f1af-47c3-bec4-250b5c066646 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:27.132360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:27.133233 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:27.133521 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:27.133801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] PATH_INFO: `/v3/projects/daabf8749ac24c429c533a3afbaec6f0/users/c456945e37f14727a50666116e0d3a73/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:27.148217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daabf8749ac24c429c533a3afbaec6f0, user_id=c456945e37f14727a50666116e0d3a73, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:27.150862 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:27.215607 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1431/2853] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:27 2022] PUT /identity/v3/projects/daabf8749ac24c429c533a3afbaec6f0/users/c456945e37f14727a50666116e0d3a73/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:27.219445 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:27.229888 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be66d30b-f866-49b0-af1f-03f16ecdafb3 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:27.286105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e776c-515b-4e56-94f4-729c0eeae3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:27.286764 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e776c-515b-4e56-94f4-729c0eeae3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:27.287048 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e776c-515b-4e56-94f4-729c0eeae3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:27.287353 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e776c-515b-4e56-94f4-729c0eeae3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:27.288076 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e776c-515b-4e56-94f4-729c0eeae3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:27.289670 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e776c-515b-4e56-94f4-729c0eeae3fb admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:27.300205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1423/2854] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:48:27.304369 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:27.315270 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4ad4f-79c4-4895-895e-adcded2e1242 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:27.319903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:27.320803 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:27.321113 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:27.321394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] PATH_INFO: `/v3/projects/daabf8749ac24c429c533a3afbaec6f0/users/c456945e37f14727a50666116e0d3a73/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:27.323414 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daabf8749ac24c429c533a3afbaec6f0, user_id=c456945e37f14727a50666116e0d3a73, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:27.326289 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:27.336760 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1432/2855] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:48:27 2022] PUT /identity/v3/projects/daabf8749ac24c429c533a3afbaec6f0/users/c456945e37f14727a50666116e0d3a73/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:27.346686 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:27.346979 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:27.347291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:27.374279 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] MFA Rules not processed for user `c456945e37f14727a50666116e0d3a73`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:27.375586 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:27.440735 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1424/2856] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:48:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:27.451821 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:27.453535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:27.509888 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71695715-dfca-44a9-a8e4-27049ec7e1d5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:27.513673 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:27.514307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:27.514630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:27.514911 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:27.570619 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:27.572216 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:27.581320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1433/2857] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:33.828537 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:33.829952 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:33.842738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50256b08-363c-4e7a-b719-4cc766de2c39 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:33.846659 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85868e0-4624-4f15-94d6-b9ca3fc0bc13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:33.847479 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85868e0-4624-4f15-94d6-b9ca3fc0bc13 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:33.847869 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85868e0-4624-4f15-94d6-b9ca3fc0bc13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:33.848521 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85868e0-4624-4f15-94d6-b9ca3fc0bc13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:33.860070 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85868e0-4624-4f15-94d6-b9ca3fc0bc13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:33.861671 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85868e0-4624-4f15-94d6-b9ca3fc0bc13 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:33.872296 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1425/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:38.899771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:38.901197 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:38.973659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e31ce4-f0b9-4077-a129-e135e408c921 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:38.978900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:38.979596 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:38.979873 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:38.980146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:38.981999 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:38.994961 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:38.996581 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:39.007544 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1434/2859] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:48:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:48:47.948306 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:47.948755 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:47.948854 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:47.967635 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] MFA Rules not processed for user `b393a07dc5f64481938d72412e27bc02`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:48:47.968856 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:48.021394 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1426/2860] 10.222.0.49 () {58 vars in 967 bytes} [Tue May 10 21:48:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:48:48.061001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:48.062513 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:48.128171 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65706b77-2d51-47fe-9966-1e6c40683445 service placement] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:48.133054 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3616916c10eb4518bef958ead7176455', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:48.133689 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:48.133968 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:48.134247 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:48.142908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:48.144538 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:48.152665 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1435/2861] 10.222.0.49 () {60 vars in 1384 bytes} [Tue May 10 21:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 10 21:48:56.197264 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:56.199829 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:56.264183 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5adbd-18ee-4c10-a6f4-d6b439b309eb None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:56.268738 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:56.269603 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:56.269885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:56.270160 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] PATH_INFO: `/v3/users/c8cae921e3984e0ab0338798785da0c2` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:56.271397 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cae921e3984e0ab0338798785da0c2)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:56.273302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:56.473272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cae921e3984e0ab0338798785da0c2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:56.555524 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cae921e3984e0ab0338798785da0c2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:56.568657 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cae921e3984e0ab0338798785da0c2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:56.569343 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cae921e3984e0ab0338798785da0c2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:56.577159 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cae921e3984e0ab0338798785da0c2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:56.583821 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1427/2862] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:48:56 2022] DELETE /identity/v3/users/c8cae921e3984e0ab0338798785da0c2 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:48:56.836864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:56.848906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f554491-525f-41d0-b6e0-57cc99a1de74 service swift] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:56.907400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:56.908302 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:56.908587 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:56.908864 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] PATH_INFO: `/v3/projects/1c8ec5d0210746a081edaf4a94b7b187` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:56.910052 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8ec5d0210746a081edaf4a94b7b187)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:56.912006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:57.012801 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8ec5d0210746a081edaf4a94b7b187', 'request_id': 'req-de820e82-5195-45a5-9a1f-9dc01e36a719'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.078361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8ec5d0210746a081edaf4a94b7b187', 'request_id': 'req-de820e82-5195-45a5-9a1f-9dc01e36a719'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.084078 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8ec5d0210746a081edaf4a94b7b187', 'request_id': 'req-de820e82-5195-45a5-9a1f-9dc01e36a719'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.095957 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] The token cache is being invalidate because project 1c8ec5d0210746a081edaf4a94b7b187 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:48:57.096277 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.096917 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.098718 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1436/2863] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:48:56 2022] DELETE /identity/v3/projects/1c8ec5d0210746a081edaf4a94b7b187 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:57.102737 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:57.104149 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:57.117676 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccfe9e1-17e9-4626-b20d-85bc69770a14 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:57.175042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:57.175944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:57.176228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:57.176504 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] PATH_INFO: `/v3/users/6c0442ee9a1b4285a11b0e2d3994335c` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:57.177685 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c0442ee9a1b4285a11b0e2d3994335c)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:57.179647 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:57.311339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c0442ee9a1b4285a11b0e2d3994335c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.384421 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c0442ee9a1b4285a11b0e2d3994335c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.397842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c0442ee9a1b4285a11b0e2d3994335c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.401535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c0442ee9a1b4285a11b0e2d3994335c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.406229 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c0442ee9a1b4285a11b0e2d3994335c'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.412885 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1428/2864] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:48:57 2022] DELETE /identity/v3/users/6c0442ee9a1b4285a11b0e2d3994335c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:48:57.677906 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:48:57.679447 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:48:57.692928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de820e82-5195-45a5-9a1f-9dc01e36a719 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:48:57.750363 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:48:57.751251 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:48:57.751535 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:48:57.751812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] PATH_INFO: `/v3/projects/2347a8541a00405eaea02352044f9b78` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:48:57.752993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2347a8541a00405eaea02352044f9b78)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:48:57.754892 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:48:57.875189 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2347a8541a00405eaea02352044f9b78', 'request_id': 'req-e8d66436-296c-4664-ac9c-e7e4c4bc476d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.955843 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2347a8541a00405eaea02352044f9b78', 'request_id': 'req-e8d66436-296c-4664-ac9c-e7e4c4bc476d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.961729 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2347a8541a00405eaea02352044f9b78', 'request_id': 'req-e8d66436-296c-4664-ac9c-e7e4c4bc476d'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.972654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] The token cache is being invalidate because project 2347a8541a00405eaea02352044f9b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:48:57.972958 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.973950 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-e8d66436-296c-4664-ac9c-e7e4c4bc476d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:48:57.975508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1437/2865] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:48:57 2022] DELETE /identity/v3/projects/2347a8541a00405eaea02352044f9b78 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:49:00.854675 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:00.856068 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:00.868901 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519a24f-a4d0-4c11-9b57-50269fc924c0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:00.923322 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:00.924185 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:00.924512 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:00.924791 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] PATH_INFO: `/v3/users/757785da38fb48018f10687711b9ce35` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:00.925974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757785da38fb48018f10687711b9ce35)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:00.927924 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:01.100209 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757785da38fb48018f10687711b9ce35'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.166511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757785da38fb48018f10687711b9ce35'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.178444 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757785da38fb48018f10687711b9ce35'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.179078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757785da38fb48018f10687711b9ce35'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.186773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757785da38fb48018f10687711b9ce35'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.192609 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1429/2866] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:49:00 2022] DELETE /identity/v3/users/757785da38fb48018f10687711b9ce35 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:01.197180 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:01.197653 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:01.197737 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:01.215307 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:01.216495 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:01.274065 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1438/2867] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:01.284136 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:01.285513 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:01.340548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987d34f-d203-4c10-8c98-2461077d0b13 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:01.344246 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:01.344877 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:01.345158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:01.345431 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:01.354327 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:01.355775 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:01.365754 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1430/2868] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:01.762998 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:01.764682 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:01.777654 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde891d2-b585-4420-b587-e6635e3eb7f7 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:01.782976 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:01.783871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:01.784159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:01.784437 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] PATH_INFO: `/v3/projects/41a3cb8e4cf64668bb7b89385b8a0749` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:01.785627 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41a3cb8e4cf64668bb7b89385b8a0749)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:01.787611 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:01.897146 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41a3cb8e4cf64668bb7b89385b8a0749', 'request_id': 'req-b4952740-ed33-4e47-85d4-e1411b1ed37e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.966329 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41a3cb8e4cf64668bb7b89385b8a0749', 'request_id': 'req-b4952740-ed33-4e47-85d4-e1411b1ed37e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.972624 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41a3cb8e4cf64668bb7b89385b8a0749', 'request_id': 'req-b4952740-ed33-4e47-85d4-e1411b1ed37e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.983934 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] The token cache is being invalidate because project 41a3cb8e4cf64668bb7b89385b8a0749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:49:01.984223 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.984865 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:01.986394 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1439/2869] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:49:01 2022] DELETE /identity/v3/projects/41a3cb8e4cf64668bb7b89385b8a0749 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:01.990380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:02.000302 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c673-e23c-4319-9b7b-7e193c3a1e94 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:02.054999 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:02.055817 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:02.056097 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:02.056369 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] PATH_INFO: `/v3/users/c456945e37f14727a50666116e0d3a73` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:02.057530 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c456945e37f14727a50666116e0d3a73)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:02.059497 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:02.274841 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c456945e37f14727a50666116e0d3a73'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:02.347253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c456945e37f14727a50666116e0d3a73'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:02.360253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c456945e37f14727a50666116e0d3a73'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:02.360954 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c456945e37f14727a50666116e0d3a73'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:02.368030 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-d188f273-c775-4415-a695-04fd08074a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c456945e37f14727a50666116e0d3a73'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:02.374619 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1431/2870] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:49:01 2022] DELETE /identity/v3/users/c456945e37f14727a50666116e0d3a73 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:02.783220 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:02.784660 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:02.799006 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952740-ed33-4e47-85d4-e1411b1ed37e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:02.855385 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:02.856244 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:02.856526 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:02.856802 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] PATH_INFO: `/v3/projects/daabf8749ac24c429c533a3afbaec6f0` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:02.858710 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=daabf8749ac24c429c533a3afbaec6f0)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:02.860716 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:02.953782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daabf8749ac24c429c533a3afbaec6f0', 'request_id': 'req-24226bad-024e-481c-9601-b043495ee0ae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:03.010159 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daabf8749ac24c429c533a3afbaec6f0', 'request_id': 'req-24226bad-024e-481c-9601-b043495ee0ae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:03.016276 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daabf8749ac24c429c533a3afbaec6f0', 'request_id': 'req-24226bad-024e-481c-9601-b043495ee0ae'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:03.027196 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] The token cache is being invalidate because project daabf8749ac24c429c533a3afbaec6f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:49:03.027485 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:03.028155 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-24226bad-024e-481c-9601-b043495ee0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:03.030298 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1440/2871] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:49:02 2022] DELETE /identity/v3/projects/daabf8749ac24c429c533a3afbaec6f0 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:03.035195 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ffa95-f4ef-4a2e-ac5e-fcd8052f8374 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.035660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ffa95-f4ef-4a2e-ac5e-fcd8052f8374 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.035749 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ffa95-f4ef-4a2e-ac5e-fcd8052f8374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.054247 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-851ffa95-f4ef-4a2e-ac5e-fcd8052f8374 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:03.055531 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-851ffa95-f4ef-4a2e-ac5e-fcd8052f8374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:03.113379 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1432/2872] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:03.121124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677453-2a21-4d88-a22e-929165f22839 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.122515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677453-2a21-4d88-a22e-929165f22839 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.122515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677453-2a21-4d88-a22e-929165f22839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.140519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-81677453-2a21-4d88-a22e-929165f22839 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:03.141723 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-81677453-2a21-4d88-a22e-929165f22839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:03.149620 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1441/2873] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:03.153672 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ffa95-f4ef-4a2e-ac5e-fcd8052f8374 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.164143 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ffa95-f4ef-4a2e-ac5e-fcd8052f8374 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.168761 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.169432 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.170477 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.170763 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.171548 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:49:03.171860 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.173458 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:03.185123 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1433/2874] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:49:03.189705 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677453-2a21-4d88-a22e-929165f22839 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.198853 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677453-2a21-4d88-a22e-929165f22839 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.203782 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.204459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.204745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.205019 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.205719 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.207655 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:03.287942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1442/2875] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:49:03 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:03.292325 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.302669 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d35f3-913d-48c5-a56e-01884ded2cb4 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.355978 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.356640 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.356921 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.357969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.358730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.360660 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:03.456269 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1434/2876] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:49:03 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:03.460714 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.472008 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1fd37-c8bb-4a39-8e86-cd946fbaa73a admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.476867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.477604 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.477885 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.478158 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.478882 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.480519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:03.490844 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1443/2877] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:03.494702 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.504725 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a760366-14c0-49ea-b4c9-bc791e73a52e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.509254 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cc74e-8bf0-430e-8059-78b7b09ff427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.509910 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc74e-8bf0-430e-8059-78b7b09ff427 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.510193 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc74e-8bf0-430e-8059-78b7b09ff427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.510471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cc74e-8bf0-430e-8059-78b7b09ff427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.511228 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cc74e-8bf0-430e-8059-78b7b09ff427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.512809 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3cc74e-8bf0-430e-8059-78b7b09ff427 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:03.523805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1435/2878] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:03.527643 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.537996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b866047-3d19-455b-9041-e9f39737aae7 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.542613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.543522 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.543808 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.544088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] PATH_INFO: `/v3/projects/b8f7b492c7414b318f1f169f907abb52/users/55498e06ae29470ba1614c611b5106e9/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.558201 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8f7b492c7414b318f1f169f907abb52, user_id=55498e06ae29470ba1614c611b5106e9, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.561143 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:03.633225 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1444/2879] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:49:03 2022] PUT /identity/v3/projects/b8f7b492c7414b318f1f169f907abb52/users/55498e06ae29470ba1614c611b5106e9/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:03.643967 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638cc8-d874-490e-9cf4-5533e5d77899 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.644257 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638cc8-d874-490e-9cf4-5533e5d77899 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.644535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d638cc8-d874-490e-9cf4-5533e5d77899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.677105 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-7d638cc8-d874-490e-9cf4-5533e5d77899 None None] MFA Rules not processed for user `55498e06ae29470ba1614c611b5106e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:03.678327 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-7d638cc8-d874-490e-9cf4-5533e5d77899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:03.747415 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1436/2880] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:03.752074 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.818200 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037537e0-2e05-41df-a338-7761ef384267 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.822938 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.823630 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.823915 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.824199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.824898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.828030 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:03.903700 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1445/2881] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:49:03 2022] POST /identity/v3/projects => generated 369 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:03.907802 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638cc8-d874-490e-9cf4-5533e5d77899 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:03.920253 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d638cc8-d874-490e-9cf4-5533e5d77899 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:03.976359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:03.977042 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:03.977330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:03.977611 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:03.978307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:03.980261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:04.086728 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1437/2882] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:49:03 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:04.090662 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:04.101397 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33c013-9caf-4851-87be-5e79ef741345 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:04.106062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:04.106709 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:04.106990 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:04.107400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:04.108237 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:04.109845 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:04.120147 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1446/2883] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:04.125100 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:04.135025 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf2030-2f3a-49cd-92d4-65a9c2974083 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:04.140284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:04.141145 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:04.141422 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:04.141717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] PATH_INFO: `/v3/projects/77775b3fbfcf4cbc83e3a4bcf02ff583/users/d69c7eb37daa423f9adbcc0b46e11be7/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:04.157511 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77775b3fbfcf4cbc83e3a4bcf02ff583, user_id=d69c7eb37daa423f9adbcc0b46e11be7, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:04.160176 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:04.233723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1438/2884] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:49:04 2022] PUT /identity/v3/projects/77775b3fbfcf4cbc83e3a4bcf02ff583/users/d69c7eb37daa423f9adbcc0b46e11be7/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:04.237683 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:04.248579 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483234e-3190-4ea7-b5e9-2b22b40cc0db admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:04.303508 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea5798-9b07-4a5e-b883-0596aaa57ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:04.304170 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea5798-9b07-4a5e-b883-0596aaa57ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:04.304455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea5798-9b07-4a5e-b883-0596aaa57ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:04.304736 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea5798-9b07-4a5e-b883-0596aaa57ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:04.305459 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea5798-9b07-4a5e-b883-0596aaa57ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:04.307055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea5798-9b07-4a5e-b883-0596aaa57ef7 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:04.317202 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1447/2885] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:04.321299 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:04.331375 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5692bc7-7151-44b4-b0d0-af632bf7ad84 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:04.335962 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:04.336824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:04.337102 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:04.337373 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] PATH_INFO: `/v3/projects/77775b3fbfcf4cbc83e3a4bcf02ff583/users/d69c7eb37daa423f9adbcc0b46e11be7/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:04.339346 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=77775b3fbfcf4cbc83e3a4bcf02ff583, user_id=d69c7eb37daa423f9adbcc0b46e11be7, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:04.342034 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:04.352453 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1439/2886] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:49:04 2022] PUT /identity/v3/projects/77775b3fbfcf4cbc83e3a4bcf02ff583/users/d69c7eb37daa423f9adbcc0b46e11be7/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:04.363876 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:04.364198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:04.364483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:04.392904 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] MFA Rules not processed for user `d69c7eb37daa423f9adbcc0b46e11be7`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:04.394114 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:04.460181 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1448/2887] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:04 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:04.471209 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:04.472912 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:04.528855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53a7af-f445-4938-a092-4feb65114d1e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:04.533387 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:04.534038 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:04.534321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:04.534593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:04.543830 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:04.546268 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:04.556084 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1440/2888] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:04 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:04.663928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:04.665310 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:04.677848 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423abc4-cf04-452a-be91-bab64a706df9 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:04.681398 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b85dd1-f32c-4780-afc4-5ff2c8f25e63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:04.687296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b85dd1-f32c-4780-afc4-5ff2c8f25e63 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:04.687296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b85dd1-f32c-4780-afc4-5ff2c8f25e63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:04.687296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b85dd1-f32c-4780-afc4-5ff2c8f25e63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:04.741867 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b85dd1-f32c-4780-afc4-5ff2c8f25e63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:04.743281 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b85dd1-f32c-4780-afc4-5ff2c8f25e63 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:04.752116 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1449/2889] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:09.547274 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:09.607723 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df71bf-880a-4fc6-a575-d995c27c86a4 service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:09.612562 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:09.613535 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:09.613923 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:09.614205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] PATH_INFO: `/v3/users/55498e06ae29470ba1614c611b5106e9` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:09.615407 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55498e06ae29470ba1614c611b5106e9)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:09.617358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:09.794277 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55498e06ae29470ba1614c611b5106e9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:09.867360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55498e06ae29470ba1614c611b5106e9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:09.880017 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55498e06ae29470ba1614c611b5106e9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:09.880689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55498e06ae29470ba1614c611b5106e9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:09.887358 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55498e06ae29470ba1614c611b5106e9'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:09.894261 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1441/2890] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:49:09 2022] DELETE /identity/v3/users/55498e06ae29470ba1614c611b5106e9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:09.898884 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:09.899401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:09.899507 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:09.916402 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:09.917591 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:09.977156 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1450/2891] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:09.986730 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:09.988158 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:10.043480 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901e659-06a8-49f5-8286-096f27f59453 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:10.047137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:10.047733 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:10.048015 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:10.048291 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:10.057216 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:10.058613 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:10.068419 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1442/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:10.478333 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:10.480001 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:10.492618 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe5738-fdf1-465a-9d3a-31fdec6d7fa0 None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:10.498217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:10.499088 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:10.499465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:10.499745 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] PATH_INFO: `/v3/projects/b8f7b492c7414b318f1f169f907abb52` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:10.501432 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8f7b492c7414b318f1f169f907abb52)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:10.503405 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:10.602057 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8f7b492c7414b318f1f169f907abb52', 'request_id': 'req-5a854163-51ee-4aa4-bc19-5742538727aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:10.661268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8f7b492c7414b318f1f169f907abb52', 'request_id': 'req-5a854163-51ee-4aa4-bc19-5742538727aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:10.667338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8f7b492c7414b318f1f169f907abb52', 'request_id': 'req-5a854163-51ee-4aa4-bc19-5742538727aa'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:10.679282 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] The token cache is being invalidate because project b8f7b492c7414b318f1f169f907abb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:49:10.679602 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:10.680245 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:10.681779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1451/2893] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:49:10 2022] DELETE /identity/v3/projects/b8f7b492c7414b318f1f169f907abb52 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:10.685773 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:10.695456 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5295dd-305e-4e02-bdba-4daa13cdf438 service neutron] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:10.751448 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:10.752314 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:10.752593 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:10.752866 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] PATH_INFO: `/v3/users/d69c7eb37daa423f9adbcc0b46e11be7` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:10.754037 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69c7eb37daa423f9adbcc0b46e11be7)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:10.755997 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:10.914982 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69c7eb37daa423f9adbcc0b46e11be7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.001164 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69c7eb37daa423f9adbcc0b46e11be7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.013516 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69c7eb37daa423f9adbcc0b46e11be7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.014165 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69c7eb37daa423f9adbcc0b46e11be7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.021743 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-cc5ae139-2d5c-4ba3-ae84-7bed70ab819d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69c7eb37daa423f9adbcc0b46e11be7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.027786 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1443/2894] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:49:10 2022] DELETE /identity/v3/users/d69c7eb37daa423f9adbcc0b46e11be7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:11.442752 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:11.444214 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:11.457765 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a854163-51ee-4aa4-bc19-5742538727aa admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:11.514087 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:11.514947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:11.515257 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:11.515547 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] PATH_INFO: `/v3/projects/77775b3fbfcf4cbc83e3a4bcf02ff583` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:11.517441 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77775b3fbfcf4cbc83e3a4bcf02ff583)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:11.519364 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:11.618512 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77775b3fbfcf4cbc83e3a4bcf02ff583', 'request_id': 'req-89a45566-c261-47f8-8b39-ff05d34ed7e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.689766 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77775b3fbfcf4cbc83e3a4bcf02ff583', 'request_id': 'req-89a45566-c261-47f8-8b39-ff05d34ed7e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.695448 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77775b3fbfcf4cbc83e3a4bcf02ff583', 'request_id': 'req-89a45566-c261-47f8-8b39-ff05d34ed7e4'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.706586 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] The token cache is being invalidate because project 77775b3fbfcf4cbc83e3a4bcf02ff583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80290) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:49:11.706793 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.707453 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-89a45566-c261-47f8-8b39-ff05d34ed7e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:11.708987 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1452/2895] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:49:11 2022] DELETE /identity/v3/projects/77775b3fbfcf4cbc83e3a4bcf02ff583 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:11.714858 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20147-b5f5-47b7-8fa5-25cfdfbdb583 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:11.715380 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20147-b5f5-47b7-8fa5-25cfdfbdb583 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:11.715471 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b20147-b5f5-47b7-8fa5-25cfdfbdb583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:11.733263 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-36b20147-b5f5-47b7-8fa5-25cfdfbdb583 None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:11.735022 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-36b20147-b5f5-47b7-8fa5-25cfdfbdb583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:11.795515 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1444/2896] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:11.803924 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853db486-14b8-40b4-b5dd-0513828c7a7e None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:11.804231 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853db486-14b8-40b4-b5dd-0513828c7a7e None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:11.804505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853db486-14b8-40b4-b5dd-0513828c7a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:11.823484 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-853db486-14b8-40b4-b5dd-0513828c7a7e None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:11.824691 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-853db486-14b8-40b4-b5dd-0513828c7a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:11.832779 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1453/2897] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:11.837045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b20147-b5f5-47b7-8fa5-25cfdfbdb583 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:11.847352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b20147-b5f5-47b7-8fa5-25cfdfbdb583 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:11.852307 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:11.853043 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:11.853332 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:11.853612 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:11.854339 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80291) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 10 21:49:11.854649 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:11.856317 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:11.869360 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1445/2898] 10.222.0.49 () {58 vars in 1152 bytes} [Tue May 10 21:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 10 21:49:11.873532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853db486-14b8-40b4-b5dd-0513828c7a7e None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:11.883839 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853db486-14b8-40b4-b5dd-0513828c7a7e None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:11.888505 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:11.889462 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:11.889742 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:11.890017 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:11.890767 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:11.892875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.037993 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1454/2899] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:49:11 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:12.041986 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.052855 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a3fed8-88b4-4fd5-bb2f-7c0ca0353b3e admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.108189 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.108853 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.109140 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.110544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.111284 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.113200 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.178420 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1446/2900] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:49:12 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:12.182514 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.192812 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8530f1-3dcb-4a25-9fdc-946d758d0590 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.197568 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.198229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.198511 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.198788 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.199592 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.201198 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.211464 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1455/2901] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:12.215414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.226206 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b0303-28a6-46ce-8d8d-09b4a1d37350 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.231008 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e26730-3d96-4873-9335-d4a761c3fb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.231682 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e26730-3d96-4873-9335-d4a761c3fb4c admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.231969 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e26730-3d96-4873-9335-d4a761c3fb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.232244 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e26730-3d96-4873-9335-d4a761c3fb4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.232974 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e26730-3d96-4873-9335-d4a761c3fb4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.235608 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e26730-3d96-4873-9335-d4a761c3fb4c admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.247704 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1447/2902] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:12.252383 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.262317 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee93d-c2c6-41fe-ac86-fc09dd558ee6 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.267470 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.268341 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.268621 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.268896 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] PATH_INFO: `/v3/projects/dd4d4912c9a54f40b20713d73eda31b7/users/b459d23aac264b298bbe3a349ab3d41e/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.284023 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d4912c9a54f40b20713d73eda31b7, user_id=b459d23aac264b298bbe3a349ab3d41e, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.286659 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.378822 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1456/2903] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:49:12 2022] PUT /identity/v3/projects/dd4d4912c9a54f40b20713d73eda31b7/users/b459d23aac264b298bbe3a349ab3d41e/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:12.389137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06651192-9caf-4492-a195-40fb225bf541 None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.393028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06651192-9caf-4492-a195-40fb225bf541 None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.393028 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06651192-9caf-4492-a195-40fb225bf541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.416933 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-06651192-9caf-4492-a195-40fb225bf541 None None] MFA Rules not processed for user `b459d23aac264b298bbe3a349ab3d41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:12.418137 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-06651192-9caf-4492-a195-40fb225bf541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:12.481103 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1448/2904] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:12.485954 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.546176 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6b242-7924-465d-beaa-49ecaa76f5c9 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.550871 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.551563 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.551849 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.552124 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.552817 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.554726 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.637066 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1457/2905] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:49:12 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:12.641944 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06651192-9caf-4492-a195-40fb225bf541 None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.652929 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06651192-9caf-4492-a195-40fb225bf541 None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.707525 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.708188 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.708470 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.708741 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.709440 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.711364 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.795505 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1449/2906] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:49:12 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:12.799942 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.810483 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7aacb-29ee-4855-93fd-c67227a72907 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.816048 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.816698 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.817038 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.817320 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.818102 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.819732 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.830784 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1458/2907] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:12.835039 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.845514 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f66b8b-460b-4599-a825-fb205fa290ea admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.850766 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaac1f0-2285-4e36-8fe8-f4ff153dc592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.851500 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac1f0-2285-4e36-8fe8-f4ff153dc592 admin admin] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.851876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac1f0-2285-4e36-8fe8-f4ff153dc592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.852154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaac1f0-2285-4e36-8fe8-f4ff153dc592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.852890 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac1f0-2285-4e36-8fe8-f4ff153dc592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.854475 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaac1f0-2285-4e36-8fe8-f4ff153dc592 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.867467 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1450/2908] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:12.872764 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:12.883444 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d35b3-4a62-4c6a-992e-6d7741247152 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:12.888055 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:12.888861 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] REQUEST_METHOD: `PUT` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:12.889140 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:12.889440 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] PATH_INFO: `/v3/projects/fb44fad126b34ae69713ce1aa2bc67f1/users/476e7c8336aa4b0db2a9363c39e98c2f/roles/caa01d8eaed74e7a886bc75acdaff590` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:12.906540 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb44fad126b34ae69713ce1aa2bc67f1, user_id=476e7c8336aa4b0db2a9363c39e98c2f, role_id=caa01d8eaed74e7a886bc75acdaff590)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:12.910585 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:12.998647 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1459/2909] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:49:12 2022] PUT /identity/v3/projects/fb44fad126b34ae69713ce1aa2bc67f1/users/476e7c8336aa4b0db2a9363c39e98c2f/roles/caa01d8eaed74e7a886bc75acdaff590 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:13.010994 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e289-ff58-4144-b8f2-7f25c85d58fd None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.011321 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e289-ff58-4144-b8f2-7f25c85d58fd None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.011602 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640e289-ff58-4144-b8f2-7f25c85d58fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.040053 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-1640e289-ff58-4144-b8f2-7f25c85d58fd None None] MFA Rules not processed for user `476e7c8336aa4b0db2a9363c39e98c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:13.041310 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-1640e289-ff58-4144-b8f2-7f25c85d58fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:13.102836 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1451/2910] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:13.107515 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:13.167530 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5bf29-2791-45dd-bbff-79bf26e2790c admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:13.172532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:13.173186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.173473 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.173755 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] PATH_INFO: `/v3/projects` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.174465 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:13.176386 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:13.251949 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1460/2911] 10.222.0.49 () {60 vars in 1152 bytes} [Tue May 10 21:49:13 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:13.256212 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e289-ff58-4144-b8f2-7f25c85d58fd None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:13.266998 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640e289-ff58-4144-b8f2-7f25c85d58fd None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:13.320691 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:13.321359 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.321646 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.321930 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] PATH_INFO: `/v3/users` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.322627 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:13.324582 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:13.398489 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1452/2912] 10.222.0.49 () {60 vars in 1143 bytes} [Tue May 10 21:49:13 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 10 21:49:13.405671 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:13.416217 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f1e8f5-91ea-4c4b-8c03-540289bc438e admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:13.420900 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:13.421496 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.422338 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.422816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.423629 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:13.425229 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:13.435708 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1461/2913] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:13.440560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:13.450395 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f9088a-b5a7-404e-9df6-244f843dce69 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:13.455205 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:13.456065 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.456347 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.456624 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] PATH_INFO: `/v3/projects/7e644cd7e2ee428f970f479ce2f5d3ee/users/9b2a3bae805a4a61b488e7c2a8304a88/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.471680 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e644cd7e2ee428f970f479ce2f5d3ee, user_id=9b2a3bae805a4a61b488e7c2a8304a88, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:13.474606 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:13.555272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1453/2914] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:49:13 2022] PUT /identity/v3/projects/7e644cd7e2ee428f970f479ce2f5d3ee/users/9b2a3bae805a4a61b488e7c2a8304a88/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:13.559268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:13.569875 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f229b-401d-4bcb-bafa-3d005799f996 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:13.624492 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4ae9d-d58f-469c-a383-6e9053025836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:13.625780 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ae9d-d58f-469c-a383-6e9053025836 admin admin] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.626062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ae9d-d58f-469c-a383-6e9053025836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.626361 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4ae9d-d58f-469c-a383-6e9053025836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.627084 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4ae9d-d58f-469c-a383-6e9053025836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:13.628725 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4ae9d-d58f-469c-a383-6e9053025836 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:13.638261 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1462/2915] 10.222.0.49 () {58 vars in 1121 bytes} [Tue May 10 21:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 10 21:49:13.643175 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:13.653064 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab0870-c543-46e7-ac9c-0611af9c6d29 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:13.657683 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:13.658544 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.658822 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.659094 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] PATH_INFO: `/v3/projects/7e644cd7e2ee428f970f479ce2f5d3ee/users/9b2a3bae805a4a61b488e7c2a8304a88/roles/b16b59e995b44fdd9abdc47cf100f2c1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.661330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e644cd7e2ee428f970f479ce2f5d3ee, user_id=9b2a3bae805a4a61b488e7c2a8304a88, role_id=b16b59e995b44fdd9abdc47cf100f2c1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:13.663996 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:13.674423 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1454/2916] 10.222.0.49 () {60 vars in 1482 bytes} [Tue May 10 21:49:13 2022] PUT /identity/v3/projects/7e644cd7e2ee428f970f479ce2f5d3ee/users/9b2a3bae805a4a61b488e7c2a8304a88/roles/b16b59e995b44fdd9abdc47cf100f2c1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 10 21:49:13.690266 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] REQUEST_METHOD: `POST` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.690556 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.690840 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.717199 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.auth.core [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] MFA Rules not processed for user `9b2a3bae805a4a61b488e7c2a8304a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80290) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:13.718401 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:13.784438 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1463/2917] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:13.797789 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:13.799618 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:13.855114 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8914a33-2682-40c0-a47c-c87bfba546bf admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:13.858900 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:13.860126 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:13.860414 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:13.860695 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:13.914928 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:13.916391 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:13.925550 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1455/2918] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:15.925062 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:15.926456 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:15.938455 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41eb3-b10e-4448-8cd7-d0946f99d62a None None] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:15.941996 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:15.942628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:15.942928 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:15.943230 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:15.998268 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:15.999747 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:16.008532 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1464/2919] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:17.303374 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:17.311819 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5293ca-9e00-4600-ab06-1449ba46f36c service cinder] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:17.315919 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233340b4-aabf-465d-954e-488a0fdcda84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f2ddd09bc4743f585cda702c3047e3f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:17.316556 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233340b4-aabf-465d-954e-488a0fdcda84 service cinder] REQUEST_METHOD: `GET` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:17.316848 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233340b4-aabf-465d-954e-488a0fdcda84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:17.317129 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233340b4-aabf-465d-954e-488a0fdcda84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:17.325805 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233340b4-aabf-465d-954e-488a0fdcda84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:17.327255 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233340b4-aabf-465d-954e-488a0fdcda84 service cinder] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:17.336956 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1456/2920] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:22.010613 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:22.072986 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd71a9-a019-49bf-a05d-4a830c87f085 service cinder] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:22.077407 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:22.078349 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:22.078628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:22.078903 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] PATH_INFO: `/v3/users/b459d23aac264b298bbe3a349ab3d41e` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:22.080110 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b459d23aac264b298bbe3a349ab3d41e)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:22.082016 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:22.402816 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b459d23aac264b298bbe3a349ab3d41e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:22.410365 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b459d23aac264b298bbe3a349ab3d41e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:22.458296 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b459d23aac264b298bbe3a349ab3d41e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:22.471186 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b459d23aac264b298bbe3a349ab3d41e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:22.472339 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b459d23aac264b298bbe3a349ab3d41e'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:22.478292 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1465/2921] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:49:22 2022] DELETE /identity/v3/users/b459d23aac264b298bbe3a349ab3d41e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:22.482734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] REQUEST_METHOD: `POST` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:22.483238 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:22.483334 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:22.499906 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.auth.core [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] MFA Rules not processed for user `b4075d4b32a74f3abd78c38a5335cfb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80291) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 10 21:49:22.501717 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:22.560739 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1457/2922] 10.222.0.49 () {58 vars in 957 bytes} [Tue May 10 21:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 10 21:49:22.571086 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:22.572506 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:22.629960 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed85f63e-b047-43ae-a33b-832daac312c5 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:22.633551 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c298cfd105174cd89ba5ef6eb50b1601', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:22.634207 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:22.634494 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:22.634774 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:22.644450 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:22.645895 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:22.655519 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1466/2923] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 10 21:49:23.071400 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:23.072818 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:23.085262 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570df7b1-d20a-4d81-831f-c731e030a50a None None] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:23.089935 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:23.090797 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:23.091078 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:23.091381 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] PATH_INFO: `/v3/projects/dd4d4912c9a54f40b20713d73eda31b7` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:23.092557 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4d4912c9a54f40b20713d73eda31b7)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:23.094689 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:23.200154 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4d4912c9a54f40b20713d73eda31b7', 'request_id': 'req-2efa01e9-8757-48c4-9503-8bb2e09d41b0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.205413 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4d4912c9a54f40b20713d73eda31b7', 'request_id': 'req-2efa01e9-8757-48c4-9503-8bb2e09d41b0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.211459 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4d4912c9a54f40b20713d73eda31b7', 'request_id': 'req-2efa01e9-8757-48c4-9503-8bb2e09d41b0'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.283833 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] The token cache is being invalidate because project dd4d4912c9a54f40b20713d73eda31b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:49:23.284147 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.284742 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.286288 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1458/2924] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:49:23 2022] DELETE /identity/v3/projects/dd4d4912c9a54f40b20713d73eda31b7 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:23.290360 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:23.302561 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931b1c1-cfcb-47f5-98fd-4ce73cc94069 service neutron] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:23.358902 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:23.360920 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:23.361208 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:23.361486 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] PATH_INFO: `/v3/users/476e7c8336aa4b0db2a9363c39e98c2f` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:23.362771 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476e7c8336aa4b0db2a9363c39e98c2f)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:23.364728 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:23.532430 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476e7c8336aa4b0db2a9363c39e98c2f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.538768 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476e7c8336aa4b0db2a9363c39e98c2f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.604205 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476e7c8336aa4b0db2a9363c39e98c2f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.618024 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476e7c8336aa4b0db2a9363c39e98c2f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.618690 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476e7c8336aa4b0db2a9363c39e98c2f'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:23.624637 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1467/2925] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:49:23 2022] DELETE /identity/v3/users/476e7c8336aa4b0db2a9363c39e98c2f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:24.002891 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:24.004433 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:24.022698 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa01e9-8757-48c4-9503-8bb2e09d41b0 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:24.081303 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:24.082095 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:24.082382 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:24.082661 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] PATH_INFO: `/v3/projects/fb44fad126b34ae69713ce1aa2bc67f1` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:24.083876 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb44fad126b34ae69713ce1aa2bc67f1)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:24.085824 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:24.181684 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb44fad126b34ae69713ce1aa2bc67f1', 'request_id': 'req-5878feb6-d0ed-4932-9003-b6869b5791d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.186993 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb44fad126b34ae69713ce1aa2bc67f1', 'request_id': 'req-5878feb6-d0ed-4932-9003-b6869b5791d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.193785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb44fad126b34ae69713ce1aa2bc67f1', 'request_id': 'req-5878feb6-d0ed-4932-9003-b6869b5791d2'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.262272 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] The token cache is being invalidate because project fb44fad126b34ae69713ce1aa2bc67f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:49:24.262563 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.263212 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.264842 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1459/2926] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:49:24 2022] DELETE /identity/v3/projects/fb44fad126b34ae69713ce1aa2bc67f1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:24.270067 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:24.275886 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:24.284582 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4b5b-39b1-4498-a0e8-8f4fabe7e227 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:24.341908 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:24.342790 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:24.343071 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:24.343376 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] PATH_INFO: `/v3/users/9b2a3bae805a4a61b488e7c2a8304a88` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:24.345031 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2a3bae805a4a61b488e7c2a8304a88)` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:24.346951 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:24.508947 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2a3bae805a4a61b488e7c2a8304a88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.515898 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2a3bae805a4a61b488e7c2a8304a88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.599204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2a3bae805a4a61b488e7c2a8304a88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.613400 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2a3bae805a4a61b488e7c2a8304a88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.614204 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.notifications [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2a3bae805a4a61b488e7c2a8304a88'} {{(pid=80290) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:24.620825 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1468/2927] 10.222.0.49 () {58 vars in 1223 bytes} [Tue May 10 21:49:24 2022] DELETE /identity/v3/users/9b2a3bae805a4a61b488e7c2a8304a88 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:49:25.093734 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Authenticating user token {{(pid=80291) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:49:25.096352 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.fernet_utils [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80291) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:49:25.109567 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878feb6-d0ed-4932-9003-b6869b5791d2 admin admin] Validating token access rules against request {{(pid=80291) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:49:25.167166 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4075d4b32a74f3abd78c38a5335cfb6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0505b6fc7edf412485d1ca7159b626ae', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80291) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:49:25.167948 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:49:25.168235 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:49:25.168560 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] PATH_INFO: `/v3/projects/7e644cd7e2ee428f970f479ce2f5d3ee` {{(pid=80291) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:49:25.169785 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e644cd7e2ee428f970f479ce2f5d3ee)` {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:49:25.171759 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] RBAC: Authorization granted {{(pid=80291) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:49:25.303009 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e644cd7e2ee428f970f479ce2f5d3ee', 'request_id': 'req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:25.308243 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e644cd7e2ee428f970f479ce2f5d3ee', 'request_id': 'req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:25.314688 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e644cd7e2ee428f970f479ce2f5d3ee', 'request_id': 'req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7'} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:25.382726 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] The token cache is being invalidate because project 7e644cd7e2ee428f970f479ce2f5d3ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80291) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 10 21:49:25.383045 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:25.383687 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: DEBUG keystone.notifications [None req-8795cffd-acf0-4adb-bbe2-b3e1d6d805d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80291) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 10 21:49:25.385330 dv-cinder-828807-2-iscsi devstack@keystone.service[80291]: [pid: 80291|app: 0|req: 1460/2928] 10.222.0.49 () {58 vars in 1232 bytes} [Tue May 10 21:49:25 2022] DELETE /identity/v3/projects/7e644cd7e2ee428f970f479ce2f5d3ee => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 10 21:53:40.907169 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Authenticating user token {{(pid=80290) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 10 21:53:40.908577 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:53:41.026161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36716610-6aa1-4e76-8439-7c21e15e63a8 admin admin] Validating token access rules against request {{(pid=80290) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 10 21:53:41.082952 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131c273-8257-483e-b227-e3259bbbdc6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e538db4da67443e286408deb9663a083', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '711fa023a8be4b6fbf9cf36a185d4971', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80290) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 10 21:53:41.083628 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131c273-8257-483e-b227-e3259bbbdc6f service placement] REQUEST_METHOD: `GET` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 10 21:53:41.083913 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131c273-8257-483e-b227-e3259bbbdc6f service placement] SCRIPT_NAME: `/identity` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 10 21:53:41.084188 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131c273-8257-483e-b227-e3259bbbdc6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80290) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 10 21:53:41.085941 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.fernet_utils [None req-5131c273-8257-483e-b227-e3259bbbdc6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80290) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 10 21:53:41.097570 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131c273-8257-483e-b227-e3259bbbdc6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 10 21:53:41.099161 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131c273-8257-483e-b227-e3259bbbdc6f service placement] RBAC: Authorization granted {{(pid=80290) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 10 21:53:41.109541 dv-cinder-828807-2-iscsi devstack@keystone.service[80290]: [pid: 80290|app: 0|req: 1469/2929] 10.222.0.49 () {60 vars in 1365 bytes} [Tue May 10 21:53:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0)